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ABSTIACT 

presented are the findings of Project Echo, a 
research project designed to replicate an earlier study on a 
supplementary instructional program for secondary level learning 
disabled students- Brief introductory sections cover the three major 
project components (the instructional curriculum, the teacher 
training materials, and the classroom management handbook) , the five 
replication sites in Texas, and the evaluation design* The bulk of 
the document is organized around 10 elements — academic achievement, 
student attendance, student dropouts, parent involvement, community 
information dissemination, teacher training. Project Echo 
dissemination, activity audit, instructional content mastery, and 
teacher perception- For each element, a report is provided which 
outlines the following^ evaluation question of interest, 
instrumentation, design configuration, data analysis model, desigw 
implementation, and evaluation findings^ The findings are noted to 
indicate that the effects of Project Echo intervention on secondary 
learning disabled students vas positive and that the development of 
additional instructional oinimodules in more subject areas should be 
seriously considered- Technical attachments are provided which 
include a paper on a screening process related to Project Echo; 
sample data collection forms; information on the methodology used to 
investigate student achievement, student attendance, and student 
dropouts* (SBH) 
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KXCERPTS FROM THE REPORT 



In all r i /t! Echo ta^L sitist\, a screening and apprair?.iL procefifi 
conduvtv-d tn identify groups of learning disabled ^i.uden:^**. 

2, Thr Langungfi Arts and Mathematics minimodules were used more 
i-xtCfHs f vcly with target Htv.dents than were the Sciuncc.^ mlnimodule^? . 

nu n imodu Lcs . 

4. C^^horC I HLudenL^i (I O=year-olds) achieved two oi: the Chres achievement 
Ha in oh jt2ci i Vi^s . 

Ca>[H>rt 2 studentH (lj--year-olds ) exceeded all three achievement gain 

6. lir^hn Ktiulf-ntK in both Cohorts did not equal the perfomance gains 
(if thoKi' KtiuientH in the original test site* 

/. At no te.st -site was the objective that 90% of the Echo students would 
Incruase their rate ot' school attendance by 6% over their priDr attendance 
history ach U^ved. 

Tltc obj ucL LVc 4:hat 75% of the target students would increase their 
aLtfcindcMnce by 10% over their prior record was achieved by two Echo student 
group-s . 

9. Two Echo student groups had attendance rates in 1975"76 which exceeded 
I [wit of non-iCcho comparison students in the same schools, 

in, F i i L t'en-yttar-oJ d Project Kcho students dropped out of school less 
I ruqiicintly than did either (1) all J5--year^old studencs enrolled in 
urojuca Hchf)^jiH during thc^ two yeara prior to Echo implementation ^ or 
^2) non-Echn IS-yciar^olds in project schools during the implementation 
i»Mr L(.)ci * 

N. At nonu ui the Project Echo test sites were the Process Orientation 
Moduh's liHitd with Kcho teaehers as they were designed to be used* 

I All I^rojcct Echo test sites reported contacts with at least one of thu 
parcnLs of uvery jdentificid Project Echo target student in 1975-76. 

1 L (Dissemination) criteria were achieved at the three Echo terfC sites 
which L'tectL-d to conduct information dissemination conftsrences for 
rupruscntat I ves of local business firms and civic organizations, 

K*, , , . represuntat Ives of observer school districts did investigate Project 
f'lcho by observing project operations in the test schools* 

IS. From 80-^90% of the observer school representatives had obtained sufflcie 
inidersLandlng of the project on which to base an adoption-decision, 
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16, UmiQ consideration regarding the possible 1976-77 adoption of all o 
part of Project Echo had occurred in all observer districts, 

17. Nn roordinatrd (statewide) plan for creating Project Echo awareness 
among potent Inl adopters has been Implemented*** 

!H. TliiH Htndy.^.does tend to indicate that Project Echo is replicable 
*^Uh .» poL<>nLial for beneficial influGnce on the education of learning 
d i H/ih I i*<l si ndcntR . 
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INTRODUCTION 

Project Mcho was an outgrowth of a joint endeavor of four agencies^ 

tcj prnducu and tusc a supplementary instructional progrmn for learning 

.lisa!U<'d sUjdunts at tho SGCondary school level* That projects which 

:n)pnn in 19 72 and was compleiLd In 1974, resulted in several products 

and procuHHuH-^includlng 30 instructional units (mlnlmodules) , a classroom 

instructional management system, a teacher craining packages a screening 

and appraisal process, a parent invclvemant component, and an inforna- 

2 

I [on dissemination process- — which had been tasted only in the developmental 
site, Corsicana (Texas) High School, 

Kvaluation data indicated the project to be generally successful,^ 
Tho findings were considered tentative, however, becaiiae only the single 
tt-Kt Hiiro was involved and oost data collection was formative rather than 
siimntat ivu in emphasis. The major recomiendation of the cited report 
was Lhat tlu* project be replicated to determine its effectiveness with 
t'ntirt*ly new staff and students. 

In follnv/ing up on that recommendation, three of the four agencies 
(TliA, KSC XI i, and SEDL) applied to the Bureau of Education for the 
llandlcapped (BEH) for funding to replicate the project in five new test sites 
to begin In September 1974. The proposed replication was funded in January 
1975, 



The norsicana Independent School District, the Texas Education Agency , 
Education Service Center Region XII, and the Southwest Educational 
Devulopment Laboratory* 

Si'v the sfjctlon of this document entitled "Project Echo Components'' for 
a cIc'Hcr i pt ion of these products and processes, 

■ T\w Corsicana L/LD Project for Flf teen-Year-Olds , Phase I - 1972-73 
and FhaHe II - 1973-74, Southwest Educational Development Laboratory , 
July 12, 1974, 

1 
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IWifii-tl nppi icat ifsHM HuhmfLl**^ to I'M inr participation in the 
iipMini ion . I tori, wlMf^fi yn-i now niflrhilly cJeRlgn/ited Project Echo, 
tivi- iM^w Hjic'; were- Hi'li-ctcid. Thcrio ^Jtt^s ail had in operation 

! onipri iit^K I Vf^ programs of special education services (Texas Plan A) and 
ri^pri'si-nttM:! f he diverse range educational environmorits found a.mcng the 
liUirt* than I J 00 school disc trices In the state, ^ 

Hecausf uf the late start-^up and the unanticipated amount of time 
roquirrd for scretining and appraisal, very limited project implementation 
was atcompl inhed in 1974-75. Continuation authorization was sought and 
received that would focus project implementation in the 1975^76 school 
year with two student groups (l^and 16-year-Qlds) rather than the ona 
group .is originally proposed* These groups were designatad as Cohort 1, 
which consistDd of 16-year-olds who had been identified in late 1974-75 j 
and Cohort 2* Che 15-yaar=Qlds identified at the start of the 1975-76 
•icliool year* 



Svn tfuj section of this rf^port entitled "Replication Sites" for a 
di'Hcriptjon of the selected sites. 
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PROJECT ECHO COhffONENTS 
'rin^rc ,!f «' ihrr-e major componenis to tho Vto2 Echo materials used 
'iiirjiiK I'iy^i-I'*75 and 1075^76: thf' instructional curriculump called 
. I j n jMf Mlci I t's; i\w Ltciicher training maLerials, callad Process Orientation 
'Uuhiii'H; and vhv c: lassroom Management liandbook* 

i he instructional materials consisted of 30 minlmodules in three 
rantant aruas: Language Arts, Hathamatics, and Science, Each content area 
loncairu^d 10 minimodules that included both teacher and student manuals 
with appropriate overhaad transparencies, filmatripa, audio casst?tces, 
ditto masturs and student pads. Each minimodule contains pretests 
where appropriate as well as Hastery Tests, 

Thu Process Orientation Modules were designed as teacher training 
iiiateriaLs ror use Uy staff development personnel and consist of background 
Information on language and learning disabilities , simulation exercises 
j ur teacherH, and appropriate reading material* Each Module ~ there are 
iwo conLains ovurhead transparencies for group use as well as handout 
mater ials for reading and the simulation eKercises, 

Tht* ClnsHroom Management Handbook is designed for coordinators, 
iiMchorH, and teacher aides* The handbook also presents background material 
on language and learning disabilities as well as a thorough description of 
.ill instructional materials and media. The remainder of the Handbook Is 
(k'VoUnl to a description of the pupil appraisal and screening process, 
I lie instruments used (or recommended ) j and the diagnostic processes 
rucommended lor management of the minimodules by LLD students within the 
normal HchooJ conLext* 

Ancillary components include a recommended screening and appraisal 
proce^H " for identification of learning disabled students; a parent 

3 
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i nvi> 1 vpint'iU (HjrapOfient for scimulatlor f par nL^school coimnunica t i on ; 

and a auggeHted information dissemination process — for creating community 
awarimuas of the project's goals and activities. 
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REPLICATION SITES 

Five test sites were selectad to participate In the Project r.chg 
r.'plicarion effort. These sites included high schools in four school 
districLs and selected members of an educational cooperative composed 
uf Bovural districts. Those SGlecte^d represented a wide range of variance 
on suvoral envtronmuntal factors: location, school enrollment, minority 
populal ions, district wealth, facilities available, and conTOUnlty si^e. 

O n 1 VPS tun. ^ Galveston ISD's Ball High School is distinguished by 
lis size. yhu school has a greater Htudent enrollment than any high school 
in Texas. Galveston, a city of 61,809, is located in the southeast portion 
of the state on the Texas Gulf Coast. The school district has an average 
daily attendance of 10,805, including an estimated Project Echo target age 
enrollment of 1057 students, 

(^ruonville, Greenville High School is located in this northeast 
Texas eommunity of 22,043. Greenville is a comaerclal center for the 
ImmediaLu region — which is largely devoted to agriculture. The district's 
average daily attendance is 4,825 — 426 of whom are of Project Echo target 
age , 

I.aredo. Laredo is a city of 69,024, located on the TeKas-Mexico 
l)<?rder in the soutliwest portion of the state. Its school district haa an 
nvc^rage daily attendance of 19,622. Nixon High School Annex, which serves 
only ninth grade students, has an estimated enrollment of 601 Echo target 
ciffe students. 

For these brief site descriptions^ coimnunity populations were obtained 
from the 1970 U,S. Census, school district average daily attendance 
from Kho Texas Kducatlon Agency's Annual Statistical Report for 1973-74, 
and Kcho target age student enrollment estimates from local school 'districts, 

5 
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i*!iia£*. l*lano 1 8 a rapidly growLng suburban city located north of 
Ihilln.s hi ncirlli rcntral Taxas* ItH 1970 population of 17|872 in estimated 
Au hiivu moru than cluublad aintia that time. Piano ISD In 1973-74 had an 
/ivaragu daily attendance of 10,546 studonts. Haggard High School, which was 
first occupiud in September 1975, has an estimated 468 students of Echo 
target age. 

W est Central Texas Educational Cooperative, The fifth Echo test site 
was composed of three member districts of a cooperative of several small 
districts in the west central portion of the state. Echo schools included 
I hose located in Colorado City (population 5,227), Sweetwater (population 
12,020), and Roscoe (population 1|580). Average daily attendance in the 
three districts was 1490, 2603, and 456, respectively, A combined total 
of 395 students in the three high schools were of Eeho target age. 

Following implementation of the Project Echo screening and appraisal 
process in each of the five test sites, a total of 291 target students for 
project intervention were located* Table 1 provides a summary of the 
demographic charact eristics of these students* 

Two observations are worthy of note regardir^ the students. First, 
males are an obvious majority within the total group, particularly within 
the older Cohort 1 group. Second , the ethnic distribution figures illustrate 
the diverse ethnic composition found among the five selected test sites. 
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TABLE 1 



I'KOJUCr liCHO TARCI-Vl* STUDENT DEMOGRAPHIC SUMIARY 



Cohort 1 

Nuidbtir 

Sex 

% Mule 

% Fomale 
Age 

Mean 

St. Dev. 
Isthnlc I ty 

% Anglo 

% Hex, Amor, 

X ai.jck 
CohorC 2 
Number 
Sox 

% Ma 1 e 

% Female 
Age 

Mean 

St. Dev. 
iithnlci ty 

% Anglo 

% Mex. Affler, 

% Black 



Galveston Greenville 



38 

65.8 
34.2 

16.5 
0.3 

36.8 
13.2 
50.0 

48 

sq.O 

50.0 

15.4 
0.3 

27.1 
18,8 
54.2 



16 

81.3 
18.7 

16.3 
0.2 

81.3 
6,3 
12.5 

19 

63.2 
36.8 

15.6 
0.2 

78.9 

0.0 
21.1 



Vest Central 
Laredo Piano TX. Ed. Co-og 

0 37 24 



78.4 50.0 
21.6 50.0 

16.5 16.4 
0.3 0.3 

100.0 75.0 

0.0 20.8 
0.0 4.2 

43 35 31 

46.5 60.0 48.4.* 

53.5 40.0 51.6 

15.5 15.5 15.4 

0.4 0.3 0.3 

7.0 100.0 51.6 

93.0 0.0 38.7 

0.0 0.0 9.7 



TOTAL 

115 

68.7 

31.3 

16.4 
0.3 

71.3 
9.6 
19.1 

176 

52.3 
47.7 

15.5 
0.3 

46.6 
34.7 
18.7 



NOTE: Age expressed In yeara and tenths as of September 1, 1975, 
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EVALUATJON DI-ISIGN 

Project Eeho evaluation activities were focused on the 1975-76 school 
years whan the projeet was fully Implemented in all sites. The evaluation 
design, prepared and distributed in June 1975* is reproduced in the 
following four pages. Elemeiits of the design were selected to test, as 
indicated^ effects In tema of project criteria which were based on the 
original objectives of the Corsicana projectp and replication criteria which 
were based on data actually obtained in the original test site, Corsicana* 

The evaluation design was organized into 10 sections — each developed 
from stated project objectives or sets of related objectives. Within each 
section^ an evaluation question of interest is stated. In most cases, this 
is a restatement of a project objective In Interrogative form* For each 
questlonp the Instrumentation or data collection procedure to be employed 
is then described. The colimm entitled design configuration illustrates 
the data collection and intervention sequences In symbolic notation^ and 
describes the anticipated sample , The column farthest right describes the dati 
analysis model to be -employed and states the criteria by which- the project 
will be Judged, 



6 

Adapted from Gampbell, D.T,, and J*C. Stanleyp Experimental and 
Quasi-experimental Designs for Research. Chicago t Rand-McNally 
S Company, 1963 • 
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lNrrRUNBtTATlf»N 



DKiIGN (lOilFlaURATlOi! 



DATA ANALYSIS MODF.L 



I, Ui liigii MiiiiHil NtiiUyiiltti 
fii vnfh Ml iwu etiltnrl 

f iKurjEliMi), iih(» iiitvt' 

it<srBln£ dlMabled and 
wht* are ^Apuagd tis un* 
i»r mere TFuJect tcha 

1 M <«ai'h iif live Tpk.iN 
»>t I tiiiilary .'trtiiiulNf nvi't 
Mil' ft'l itiwlii)^ v^pnctyii 

.1, liiTi iMiL i>j tlli; 

NItiidi'nLN WiiJ di'BHHW 

j'ii'iU Mil in In (Hie iir 
mtifv <>f Lite tijJit^w^ 

I -iniiiiaHc '4FEk, Nuteiit^u, 

ecifi I v>i hiiiLi pi.T yi'iir? 

!»* /'# ptrwMiiL ul Eliii 

Mlu^vtMH win lit^myn^ 

{iiyiit |',;jin In ui\% or 
mifv f»r tiu* lljrt'L' 

I , i'j ^Vfi I'lil III t Ih' 

HL({dj<iit?> Wit) lii'tiiiin^ 

-I J i Ml t i'.fi I n ill f f fir 
mtn- til Llif Lftrc^c 

r,H I- ,i| j , 2 ^fiitlt 
iMiii i v,-i li'iiLi^ fivr 

iNi litjjiii Niliirtul Hi niJwjit !^ 

}|!< L h<:hii fii fMCli nl 
f f VI' Tiijt.iH ^t-ronfl/iry 
^riifHti?i, VH'Vl tUo tiil = 

til H4:ii>iii| nL ti'Iiii^iitU 
by tiZ liVfT ihulF pry^ 

ilC CfMidiiiii < ' .ijfyf 

Miiidi'iiiN wi 12 in- 

?ii'liuiii ill iuiiUsiii'u by 

!»vi'f thi-'ir pry- 
viiMiJi llif ru^yt.ir 
>!L Li'ljdiUM lilKLiiFy ? 

» » firiiui* Mil'. ill ;iL LiMKhiiii y 
r.ili' fiJ L,!Fj«el Ht!i= 

hiMiKT lii.iii tUij mL'im 
>f L CL'ndiiiiL-f' ratk- <•( 

ilui1^t;irp,4ll NtUiJohiH 
i ft thy HiitBU fichQeJsi 
dwrinp ilia implvtuoTt^ 
L.iEliin isi'fiod? 



A csnpfshetisiv^ ioa» 

battery «siilit£ln| of 
ten flubagalev In four 

Sialics, aelence, iind 
apgifiJ Rtudicti Sub^ 
Meale .^cof^g m/iy he 
yjfpfyHRyd &m firady 

Stt^^ntK will ndi8l»« 
tsttryd Efi« SATH Mpprup- 
ri«Ee EQ th«tp r¥,tding 

deCtrnln^d dyfliig the 
sEreenin^ a^ appralssl 
pretceesi Tlw 1964 edi- 
clon-^FuFPi W Qt thu equiv- 
alent 1^74 editlon-Fer* A 
may b# ijdMlnlsEtroH . 



ii Kur sMh of twu enhdrU 
within e«eh of fiv# 
Prpjefifc Echo Eest sitOHi 



I I 0 



Twu forms desifnoiJ fep 
Liibulatisn ot attcndanee 
tiain (ijf studest^. Th« 
MrsE farm la for target 
^LudtniNf 4h€^ icEs^d for 
>i tiSBp/rlKsn ■aflipl^ sf 
* ^Cudtnts. Tfie tsf^ewlng 
-tyta will be provlUtidl 

Atcpndanee records (daya 
prueent, days enrplled) 
i or each of eatlniaEyd 

target students In 
uath of EWe eshort siim- 
pii;H fyf 72-?3j 
74-75f iind 75-76. S™ 
tista for ilj aon^Earget 
ynmpaFl^rin StudenL snmx' 
plum in uach of Eh€ 
t I ve BLjiOola. 



whe rei 

I - idantif iijatiun n 
i'r»ject Kehu EiirR^L 
frtudent I 

fi ^ adsl^fitfatien of 
the iATB; and 

* ejepoeure (^) to onm 
or ftere lriatru£» 
tional iequeneea (1) 
dealfinated by suU^ 
script L for lani^uape 
arts, M far ffatbe^ 
natifis, and/sF % frr 
science, 

Hanples: Cohort 1 conilsEi 
of IS^year^old lEudenEs 
whs were Identiflt't as 
113 dufinf the spring of 
1975, Cehert 2 tensUEs 
of l^year^dld studonti 
who Bay be identified as 

In the Pall of 1975 
prior fie lutrucElenal 
pspoaure, Each cshnrE 
In anticlpafied to con- 
sist of approsimately SO 
§Eydents 111 each of five 
i^^t sltafl— a tSEal gf 
nppFOxlinately SOQ sty^ 
'Itintg* 



, Inr eagh of two cohorts 
wltliln aash of five Pfo* 
Jtu't Egho test altei: 

Tarset arudiiitat I 0 

fl9n-Earg%^ ■aBpla:. 0^ 

where: *^ 

I - idenElf loation as a 
Froject Echo target 
atydentl and 

0 * eellectiofl of specified 
aEtendange data. 

Sar'pleai Targee studenta 
csniist of Ebi Cohorti 1 
^nd 2 s^pleii identified 
absve. The nen-Earget 
^a^le EPHsists of all 
nEher studescs of the 
^ase age groyps in e^ch 
nf the five test sehoQls. 



' pg ojegj J.fj-S-Cri^n will 
hi.< ceiisldHi i<d eq he 
ndileved i* ya^h of thy 
cc^ndiElsns Hpecified in 
@valuitlc>n liueatlen of 
InEerest '^J are »E« the 
replication eritarlBn wl 11 
be conaldOF^d to be 
§rhl^ved It the fnllowlng 
hiMh reiiu][<4 frai the 
pilot tesE >ilte are 
U'ipllratfeE! : the fellow^ 
ing pcrcthiagea of pypll^ 
di^msisstrite- an average 
jif.ide equl- -^lint (GE) 
Kr.in at ih'r r4te of 1,^3 GF 
per year. 

Ungyage Arts - II, Q% 
MathehaEl - i2,)f 

^elenee - 51. 4f 



2. Tha projetE erlfierlen will 



&e considered to Ee 
achieved If eagh of the 
eondltlons specified in 
evalusElon question ef 
inEerctt l2 are aeE. 
The rgplie&tlgn erlEerJf^n 
will be eonsTdared fieE 
If target student absetir- 
eelsfi dacreasea by bli 
svet their p.ist three- 
year attendance ref-crJ. 



I < roup RiL-iin ^tti'fid^nco 
FiiEi' t»f target *itii- 
dt'nt^ wiJl be bL 
higher lli-:in tht' nt'^in 
iiEtyndyni'^ of iha»«? 
HCudenta over tlvS 
prpvltiu^ tiifee yoarnl 



COKTIWJED OH HKT PACE 



I'ROPOSKl) KVALUATtON ttlSKN FOR PROJK.T KCHO, 1975-1976 



gumiON (IK iNTEHKSf 



IHSTRUHEKTATIOH 



DFJIUN CaNFZgURATlQ!^ 



DATA ANAI.YiiiS liomi 



w)Hi are yii|tuNed to pro^ 
liM t hriiii hi Gfdi-fi uf 

!llt< filii' I'i ilFiJjH'Htli 
rli iii I hi- (IritiHifil i iiLi' 
Nlhiiiii <>Vl^ T Hit' 



4. I'll mj pi'rwi^'nt uf Lht- 
ji^irtmttt ni lyafitlliud 

dciitm in ^imh pf five 
Hittupip Mtlend BQ% of 
iiif prsjeet's Bchedulad 
|i{!reii£ invnlvenenc 
^iiclvitleii Uarlng the 
;>rMject implysencaLlyn 
jii'rlod? 



3* Projaefc Eghg Pgspg^ t 

The ruiiawlni^it* ari 

prciyhlsdi 

hi uAi li fi¥c ichsela 
hir Lii« /|^7i i€hool fmmt 
iiypihi'p ui LAr|et>-|reyp 
ilrtjpmitH, nM$cF of 

riuffibtT ef non^targec 

fKiH^tiirgf t ■ari)llq«; 
mid In ■/IBS asheyJs fgr 

liuiibsr ftf drsfgytB ai^ 
nuabef of earelles^ In 
the flAB«! agfl ranf^e am 

sEudflnts. 



Th* fsiloiriiis data srfl 
pr6vid«lt 

few »£h ef flv^ sehcslp, 

eariat ■Cudtiies, nus^f 
s£ plsansd parent In^ 
velvaMnt aetivitlcit and 
nu^cr of paiifnca of 
targat atud«Btt In attend^ 
ansa at eaeh activity. 



3, fer sach of tva eahorti 3^ The 



vlthiii «aeh sf five Pro^ 
ject Eche tpit si teat 

Target atudantai I (> 

NQn^targae aaB^lai D 

where I 

i Idantif Uatinn as a 
Prqja^t ^hfl targrc 
atudcntj and 

0 £Qlla€tl6ii sf specified 
drspsut data# 

SoBplea: Ttrget atudenEf 
Ennsiit of the Cshorti 1 
and i aan^lai Identified 
above. The nan^carHEt 
saapla esulita of ^11 
nthaf itudcfita sf the 
■aDie age groypa In ^aeh 
uf the five Cast ^chnsls. 

u Fcr eaeh Farent Invelve^ 4 
ment Activity at each 
teat aitai 



whe re i 

K a planfiad ^i;tlvltv| ^nd 

y « eollagtlsn of astend^ 
anca Inf ornatlen. 

For thlg agctisn of the 
dealgn, ''parent attendsn^e'' 
ii defined as the physical 
preeefiee of one ot mare 
adult aeniheri of the houses 
hsld in whifh a target ^|u^ 
dent faaldeis. 



Moa fTter la vt 11 be net 
by ashievemenL af a 2?, 
decraaaa in dto^pcMit t^t^ 
9fi iptglfird in evalua^ 
iiofi quesii^'n vt inter- 
mni Hi. 



T^e prslest erltef j^n will 
be se c i f ¥ 3~~p e re en £ f 
the target studenti' 
pareati attend §0 percent 
□f planned Jarent l^v<3lve- 
n^nt aetlvitiei. ^Iq jts^li^ 
eat las erttefi^, vi 1 1 be" 
applied*" 



jNt n'pf I'm'li t JIL I Vt^S ill 
hilft lill^.NM t I f fflH ,=ififi i.ivtc 
Kf^'.-lill i^VlI f UliH Ili I'ili h tif 

! iit' 1 1 vu rt|j!;i& r^flijuii-^ 

I I tf.^K hi WtiJijIl I'J'«J(.'CC 

i,rh'j Ifi Imp h'SiyntL'>t 
,ii if-itfi tint* tii twij j>ri>^ 

jf'i t hW OFI'tat toil liiN- 

!i4Mnin-'it ioli f onl e ri'iiiiu^ 
f 4<ijilyf li-d by tht> io'.al 



I.iti ulanSrtKjs teacht:r*i 
wlui Implemtjnt Projyirt 
WqIio iliiitliiLrtional 
HhiiactUulc^ i n f ivy 
yi'b^ls UL'sunstriite 
^it ttiina^Uit uf tU^ rtm- 
wcpts preNLMit^ in iI^q 
i-ryceK» urii'ncatiiin 
Hiiilyle^T 



Praj eyg jv4Ke pieaemlna ^ 
t L en f ^Qft? a r en ee~Reg^i b t f 
The fellswing ditm are 
prsvidLMl I 

Necerd^ uf the oceurrence 
and attondangc at inferma^ 
tlan diaseminatlon ganfer^ 
en^ea ^i^ndiietad far rcpre^ 
sentativ^s oi buaineaa 
^nd givic orgaeisatiaiia In 
five CQflsaunltlaa* 



l« Far each Di^&eminatlnn 
f.'fsnfirsfifie at e^eh tt^t 



6» Procaas nfianCatisn 
Hadule CriEi£lgB'^ " 
Refarenfcad Naaaurea^ - 
Ir^truKnta dealgned 
ta deeer«ins attain- 
Beat of eoneepta pre^ 
seiited in the teacher 
orientatlan to Preject 
Eehe. 



K * Ulssoinin^tlQn Con— 
ferencel and 

0 ^ eslleetlgn oi ati^nd^ 
an€e inf □rrnatlsn . 

6. Within eaati prcjegt tg^t 
alEe I 



K 0 



where i 



I. The Pf eject jnj regllaa^ 
tten grltertj jjll be 
schTeyad if tv^ Dls^ 
^eifiinatlsn Csnfc^rerces^ 

' are gsndueted, 



X " ejtpesurF to pra^ess 
prlentatie^n med ^l^p^ 
^nd 

0 » asseaifnent af eeneept 
atcainnent . 

Thd ^anple ennsists rf 
tia^sreafi teaehefs sf 
identified target students 
wu'j u§# I^n^ua^e Arts, 
HatheftaElcs , 4n^/^r 



Th# grgj^eet grlt^ri..^n 
will ha mV^ii prejfJi 
t#a^hera denti^n^t riCe 
>5ttain9ienE an aVitr^i^e 
ei 80 percent c^f aadule 
yon^^epts presents j< rhere 
is f\Q repli,:aeii^fi grit a— 
rirn aa ttie pfc^mim 
L^rlentatl^'^n tno^ulcR were 
npt smplexsd in Che pil^c 
test iite. 
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iNHrKMHKjjTATION 



Wh AHALYIIS imvl 



7* iiu ndfeliilsiriitori Mmi/ur 
liupcrvlsurN frM thf 21 
f>b««rv*r ■chsola d#iiOn^ 

fnfsrMClpn regarding 
the esi^Qi»nEi and 
iipcra«isn of Pf^jict 
Kvfio aa iBplamanled in 
t I VI? aGhotiln which la 
riui»lderefJ by thy 
friiject UlruiUur aa 
1 111 ufwiEii»n uRefui as 
inpyt InttJ the docl^ 
iiidR Cq adupt tha 
■Ddei Uuring 7&-77? 

it tJff^M an evaiuaiiflm 
itudit 6f lbs ptajact 
ia^IaMistatien (Inttr^ 
yentlon aed raplica^ 
tlon atrateitiag) in 
five achoola indicaty 
Ihat tha roiXQving 
nt-tivitiatt and prec- 
i-'Haea yier^ a^Qom^ 
pilahad as /irttigl- 
i»nted'f 

itm tlta ptipll BEfccri^ 
Ing and idantifi^ 
cacitiii pfyc^aa? 

b> Uaa iRstrucLiyii" 
ml auppert utarisla 
«fith IdenEiflad L/LU 
BCudanta? 

Km ObacrVatisB of tha 
eparatlon of tha L/LD 
■odal hy rapraaaAta» 
fcivaa of tha sluatef 
aaasciacy ashoslaf 

d^ Tlia adyptlDn^dgcittiiiB 
prDeaaa in tha obfie^*^ 
var ■ehoula? 

a« Uayaioppanl of a 
Mtatevide plan for 
diaa«iifMtio& of 
infetHtioR abpiit thf 
Hdel ail Plan A 
itchsoia? 

Kur aaeh of JO Prejgiit 
Kf'lm liiRLrui'tlenal ninl- 
■iHluiaa, do ttU parcant 
oi taFiti atiidaiitH, 
a! tut aspuaurt; to tha 
prsjact InlervahElun, 
d^HonatraEe aaaEary of 
8UI of tha ■ajor in^ 
aErucEionai ubjaeElyaa 
addraaaed hy the nlni- 
Bodulaa? 



7i Thaaa prdcasa data will 
eollei^ted by Interwal 
intafvliv i^ith tha fto^ 
Jaet Dlraetori 



Vhv intarvtey will b« 
ccndusead prior to 
H«y Ui 1976. 



; Thaae audit data vlil 
ba sollaetad hy Inforaal 
tnEarview irlfch apeEifis 
paraoiiiial saaoslated 
with Preja^t Isho: tha 
CoordlnaEor at tach of 
Eha fiva tEBt eitaa 
(fluaatisna tha 
IdanKiflEd adalnlitraEer 
or mparvlsor ftin aaeh 
uf 25 cluetar aaayci^ 
ata fibaervaf aEhosla 
(quaation id), and Eha 
FvojarE Di racier Cquaa» 
tion 8a) ^ Tha Intar^ 
vla« aay ba conducted 
duriB| a site viaic or 
by talaphonai 



tha data cellegtisa 
■shadyla say vary in 
diffaranE aitaa. All 
data vi41 be cellaetad 
prisr £a May 31, 1976. 



Minlpedulg Haitary Tait*!^ 
a aariaa of 30 erltarlofi^ 
rafaransad saaaurai, assh 
datlgnad to teat stydant' 
■aaEcry of Eha siajer 
■iryecional sbjae£ivaa sf 
ona of the 30 froJa^E leto 
Bi&^edulea. fba aarlM 
sonEaina tan la^yaga f ca 
taatBi tan aathastlca 
taatip and ran a£iao^ 
taati* 



for aash tmtgmt BBbdanti 



iU'oeaaa datj will %a J«te- 
utei'itl^ wliliotti ipaeif^u* 
fdi3ptlf4if!ation at ebat<r^ 
v#i- aeh^la^ t'fiftrton 
vill ha aehiavad If ona 
adsittiati'atcir or aupar-^ 
vt^er fr£B tash ebaarvalf 
•sUool i*i Eynsidirad by 
ehb fr:p^p€t Dlratter to 
eonp^ahand QparaEion of 
ehe Projast Echo aedal. 



0^£ufrasca sf m^th of 
th^ freEaaaia idf'^Clfiad 
In avalyation qya^cloii 
of Usanat #i trill hm 
^.^ial4arad ai attalia^ni 
/i eritczia* 



X > BCudast axppsyra to 
oi^ of a sarlaa of 
Initruotlofial Blnl^ 
Bodylaa; aed 

0 ■ asaeaaMAt of obJfcElva 
eaatary , 

i^^lai isi^aat a^plas 
eosalst sf all Idanci^ 
flad ^K^mt atud^ta 
^o ara eaipoaad to on^ or 
■ora Pf^Jeot Esho slnl- 
■edylai . 



Corraet raiposaaa of SOl 
of the Eargat itudanta 
to 8S% of tha lEsi of 
each Haatary Test vlU ba 
coniidarad Indicative of 
Baaeary of the sajor In^ 
acrustlsnal abJacElvts of 
that siniiisdula. Is ad- 
dlElon to the basl^ anal* 
yiii sodali tiaatery test 
findlnga will be analyiad 
hy student aie groyp, SEip 
athnlctty, and teat slEa 
Es explore and doc^ent 
any poiiible oastefy ilf- 
far^ngaa vlehln these 
targat aEudenE ■ubgrsups. 



CultlUU£U ON KSfT FACe 
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. i'>ii ilJiliilK i iiihfiriiolH 
Mrii< lii I'^ii ii iilNifUi ^ 

t hmui inliiiMiHlii f i< wiLh 

.tt IffiiHl llvi* Htiidi'iltH, 

•!»* 80 ptifvL'iiL of }'fi»J«e^ 
itiitli 

a* a BiiJaflEy of tU^ 

b« infltrutCioQii tiite 

not cjti-yRglve? 
t . pK-.^aral inn Llihe r^*^ 

thy quytiEity of 
■atlvrLiiih and sl-UIs 



« ehAeUiit fsfHiE. d^ 

wmpeztm and ptfccpliena 
rsiAfdifif £bc y«« of Pre^ 
Jiet ^9 niniMe^ules. 
ftS3Yifl#ii li sad* t& 

€MHiiiEa and •ufgssti^iia 
tet ■Inlfi^duli isprsv«^ 
■■Rti Cottplatlan of 
th« Eh«Ekllat li jntli:«^ 
Ipagad £9 raquirc 
nlnut ka fsr aagh mirii^ 
ssdula usad, 



Ml. J f.r vin \% I'rn j(M « hijn; 

wii^r^ % 

% ^ uaa of on0 ef a 
ierles of Initcru^- 
EioAal mihlBQduIe^ 
with five or more 
tilrget studpniHi 
Slid 

0 » csi^lttien of 

S^mpl^i TeA€^ef sanplr 
csnstiti of all Pro- 
Jcec Eshq glaaaroon 
(and/oF rsasyrct room) 
teacheri who usi one 
Of mors mlfiinQdylf i 
with fiv^ Bf mofg 
target itudanCi, 



Wi ptfeent fjf the tt^eh^ 
Of* uAlni fe«Rh PfojecE 
i-qho minimoJulc- ti^ 
Teaeher CheckliKe i lsps 
addrasaing sach af«a e^f 
eoncarn idcntifitd in 
question of iht#Fi9t ^'10 
viil ba songldered itfi 



rlalf .ititij »dta nro» 
vlded Wiia appropri- 
ate? 

E'i^j •AdL£ry t^sL pro^ 
vidied ,1 valid imUcA^ 
flon si sEydan£ ledrrt^ 

Cha instruct iono I ub^ 
jtcCivdN uf tht? mlnl^ 
■sduia i^ff^ appraprl-' 
ate to 'ihe cdyeAtlonal 
Qfiads iaeaE of th4 
Htudaiiti^f 



h« cha yue^^iar]f And 
r^^in}{ laval ol 
Student books iraa at 
an appropriatB It-v^l 
for WHt of tha 
ifCudanLH? 
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FORMAT OF THIS REPORT 

*riii» m«iln body of tliln report 1e organized around the 10 alementSi 
or Ht'v\ fonsj or I he tjvaluation dciBign which wan reproduced on the precedi 
p#igc!.4, For purpoHes of clarity, each section is glyen a short title 
which dcBcrlbes the central focus of that portion of the avaluation. 
Titles used for the report sections arei 

1* Academic Achievement 

2* Student Attendance 

3. Student Dropouts 

4 • Parent Involvement 

5, Cowiunity Infomatlon Dissemination 

6, Teacher Training 

7, Project Echo Dlssealnatlon 
8* Activity Audit 

9* Ins cruet ional Content Mastery 
10, Teacher Perceptions 

These sectlonB are in the^same sequence as the 10 elements of the 
evaluation design. Each page Is Identified by sectlpn^nwiier and title. 
In this way J the reader may quickly locate information about any element 
of the design. 

Each of the 10 sections of the report contains six or seven parts * 
The first four (A=D) are those from the evaluation design. Part 1 
dlscusaes the IjAplementatlra of the evaluation design, including actual 
sample sl^es, any changes or modifications which were made, and general 
procedural descriptions* Part F includes the findings of that section 
of the design ~ essentially the response to the question of interest 
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whlcli was posed. Additional or unanticipated findings relative to that 
tloHlgn Kttctlon may be Ineluded* If conKldered appropriate, a final part, 
Ivclinical Attachment (Part G) , was prepared. These attachftents provide 
motu dutall than is of interest to the casual readur " e.g*, computational 
iurmulao or complex methodological procedures. 

An outline of each report section would contain these parts i 

A. Evaluation Question of Interest^ 

B. Instrtuaentatipn / 

\ Developed prior to 

C. Design Configuration f the evaluation, 

D. Data Analyaia Model / 

E. Design IiDplementatlon ] 

F. Evaluation Findings ; Prepared after the evaluation, 
G» Technical Attachment (optional)/ 

The Evaluation Flndinga part generally contains tabular data presentation 
in addition to a narrative discussion of the findings. 

Following section 10 is a brief aimu^ of najor findings and a series 
of recommendations/ 
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SECTION 1 
ACAnKMIf: AClilKVEMMT 
A. I'lv^f I n.it i on QuuKtinn of InLurest 

\}n liigh NchonI BtuduntB in each of two cohort swples (see Design 
Configuration), who have been dlagnosad as learning disabled and who 
aru uxposed to one or more Project Echo ingtruational sequences In each 
of five TexaB secondary schools, meet the following expected outcomes i 

a. 90 percent of the students will demonstrate a grade 
equivalent gain in one or more of the following 
academic subjects ™ language arts, science, and 
mathamatlcs =^ at a rate of 0,8 grade equivalents 
per year? 

b. 75 percent of the students will demonstrate a grade 
equivalent gain in one or more of the three subject 
areas at a rate of 1,0 grade equivalents per year? 

25 percent of the students will demonstrate a grade equivalent 
gain in one or more of the three subject areas at a rate 
of 1,2 grade equivalents per year? 

InsErisientatlon 



Stanford Achievement Test Battery (SATB) " A comprehensiva academic 
achievement battery consisting of 10 subsMles in four general areas — 
language arts, mathematics, science, and social studies « Subscale scores 
may bo expressed as grade equivalents* 

Students will be administered the SATB appropriate to their reading 
comprehension level as determined during the screening and appraisal process . 
The 1964 edition^Form W or the equivalent 1974 edition-Form A may be 
administered, 
C . Design Configuration 

For each of two cohorts within each of five Project Echo test sites-. 

XL 

I ^ 0 



] 

where: 
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1 = Ldentification as a Projoct Echo target student | 
0 ^ administration of the SATB; and 

X. - exposure (X) to one or more instructional sequt^ncey (i) 
designated by subscript L for language arts, M for 
mathematics, and/or S for science. 

Samples I Cohort 1 consists of 16-yaar-Qld students who were identified 

an LD during the spring of 1975* Cohort 2 consists of IS-year-old students 

who may be Ldentlfled as LD In the Fall of 1975 prior to instructional 

i*Kposuro. Kach cohort is anticipated to consist of approxlmatelv 50 

Htudents in uach of five test sites — a total of approximately 500 students 

I). Pat a_ Analysis Model 

The prolect criterion will be coa^idered to be achieved if each of the 

conditions specified in evaluation question of interest #1 are met* The 

replication criterion will be considered to be achieved If the following 

SATB results from the pilot test site are duplicatedi the following 

percentages of pupils demonstrate an average grade equivalent (CE) gain 

at the rate uf 1.0 GE per year, 

, Language ArtB - 51.0% 

Mathematics - 42.32 

Science - 51.4% 

K» Design Imp 1 erne nta^t io n 

Project Echo was implemented in five test sites in 1975-76, The size 

of both student Cohorts was smaller than anticipated. Two sites did not full^ 

implement the program with 16-year-old students. The number of students 

by site and Cohort who were exposed to one or more Project Echo 

instructional sequences (Language ArtSi Mathematics ^ and/or Science) and 

who received both administrations of the Stanford Achievement Test were^ 
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S i tc[ N-Cohort 1 N-Cohort 2 

Halves ton 0 40 

<;rc?t'nvi 3 le 12 14 

i»iru(l(> 0 36 

IMano 29 9 

W, Central Tex. Educa. Co-^op, ^ 32 

TOTAL 60 m 151 



Not all students completed all subtests of the SATB. Students with 
incomplete subtests were deleted from analyses involving those subtests; 
ihoruiore some raported sample sliea may be less than indicated in the 
lablu above. 

Additional Information may be found In Technical Attachment 1, 
K* Evaluation Findings 

Cohort 1 students (16--year--olds) achieved two of the three achievement 
gain oh j ec t Ives * The objective not met^ that ",**90 percent of the students 
will demonstrate a grade equivalent gain in one or more of the following 
acaderalc ^subjects — languaga artSs science j and mathematics " at a rate 
of 0*8 grade equivalents per year" was very nearly achieved, as 88.33% of 
the 16-year-Qlds deaonstrated that rate of gain in at least one subject 
urea. The remaining objectives were easily achieved. See Table 2, 

A finding beyond the minimtm achievement gain criteria was that 30*00" 
of the Cohort 1 students exceaded the expected achievement gain rate in 
all three of the tested subject areas. An additional 31*67% demonstrated 
gains at a rate of 1.0 G-E, or greater per year in two of the thre# subject 
areas addressed by the Echo materials. See Table 3. 

Cohort 2 students (15^year-"0lds) exceeded all three achievement gain 
objectives - 90.07Z had G.E. gain rates of 0,8 G,E. per year in one or more 
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niibjiM i /irons; 89.40% (ixcytided a 1*0 (i.E. per year rate; and 84.10% surpassed 
L.2 (LK, pvr year In at least one area. See Table 2, 

Buyond these findings, it Is noted that 16*56% of the 15-year-olda 
mada gnlns at a rate* of 1,0 G,E. or greater in all three areas — Language 
Arts, Mathematics^ and Science. An additional 41.72% exceeded that rate 
in at: least two of the tested subject areas. See Table 3* 

In spite of these positive findings. Echo students in both Cohorts 
(lid not L^q ual the performance gains of those students in the original test 
iilS (('orsJcnna) for the project materials. The percentage of Cohort 1 
sLudcmiB with a 1,0 G.E, or greater gain in Science (50*88%) came close 
tu duplLcating the 51*4% replication criterion, which was based on the 
pi^rformance of 15-year-^old Corsicana students in 1972-73, All other 
percentages fell short of the replication criteria* See Table 4, 
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TABLE 2 



NUMlsi'R AND PERCENTAGE OF TARGET STUDENTS KCE130ING STATED GRADE EQUIVALENT GAIN 
OBJECriVl'iS ON THE STANFORD ACHIEVEtffiNT TEST IN ONE OR MORE OF THREE SUBJECT AREAS 



Cohort 


I 




16. 


-Yaar-Olds 


EKceedlng 


G.E, 


Gain Criterion 


Rate of CK 


I. Gain 






Ntfinber 








Parcent (of 60) 




than 0.8 


G,E,/Yaar 




53 








6", 33 


i f r on to t 


Lhan J.O 


G.E./Year 




53 








88.33 


Croater 


tiian 1,2 


G,E*/Year 




52 








8^.67 


Cltihort 


2 




15= 


^Year-Olds 


EKcaadlng 


G,E, 


Gain Criterion 


Kntu or C.F 


"i. Gain 






Number 








Percent (of i51_)_ 


(iroator 


than 0.8 






136 








90.07 


(truater 


than 1.0 


G.E,/Year 




135 








89.40 


Cruatar 


than 1.2 


G,E,/Year 




127 








84,10 



NOTE: Numbors and percentages raported are cumulative and 
therafore do not total to *100%. 
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TABLE 3 



NUMBER AND PERCENTAGE 01 TARGET STUDENTS EXCEEDING E^ffECTED 
GRADE EQUIVALENT GAINS ON THE STAOTORD ACHIEVEIffiNT TEST 





Cohort 1 




16-Year-Olds 


Exceeding 


G,E, Gain Expectation^ 








Number 




Percent (of 60) 


Al J 


1 hree Subject Areas 




18 




30,00 


Two 


dT Thrw Subject Areas 




19 




J A ♦ Q / 


One 


of Three Huhjuct Areas 




16 




26.67 


One 


ur More Sublecc Areas^ 




53 




88.33 




Cohort 2 




15-Year-Olds 


Exceeding 


G.E, Gain Expectation 








Number 




Percent (of 151) 


All 


Three Subject A.reas 




25 




16.56 


Two 


of Three Subject Areas 




63 




41.72 


Una 


of Three nubject Areas 




50 




33.11 


One 


or More Subject Areas" 




135 




89.40 



NOTES : 



The three subject areas addressed by the Echo curriculum and tested by the 
Stanford are Language Arts, Mathematics , and Science* 

Performance criterion was that 75% of students would exceed G,E, gain expectatit 
In one or more subject areas. 

Expected grade equivalent gain is at the rate of 1,0 grade equivalents per year, 
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TABLE 4 

PERCENTAGE OF TARGET PUPILS DEMONSTRATING AN AVERAGE 
GRADE EnUIVALENT GAIN AT THE RATE OF 1,0 G,E./YEAR 
m PRO^CT ECHO SUBJECT AREAS 



Subject Area 


Peraant with 1.0 G 


.E./Year Gain Rate 


Replication 
Criterion 




15-Yaar-Olds 


16-Year-Olds 


Language Arts 


33,66 % 


33.03 % 


51.0 % 


HathcimaClC' 


34,54 % 


37.36 % 


42.3 % 


Sclunee 


32.88 % 

^ — _ 


50.88 I 


51.4 % 
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SECTION 2 
STUDENT ATTENDANCE 

A. QiK'stion of In t ares t 

Do high school students who are exposed to Project Echo in each of 

} Ivv Tt'xnH Hi^condary schools meet the following expected outcomes* 

/u 90 in.'rcent of the students will increase their rate 
of srhool attendance by 6% over their previous threo- 
year attL-ndance history? 

h. 75 i>prcent of the students will increase their ratf- of 
school atcendance by 10% over their previous three-year 
nt tendance^ history? 

r, nroup mean attendance rate of target students will be 6% 
highur than the mean attendance rate of nontargec students 
in the same schools during the Implementation period? 

d. Group mean attendance rate of target students will be 6% 
higher than the mean attendance of those students over the 
previous three years? 

PrcjjecL ICcho Student Attendance Forms — Two forms designed for 

tahulalion of attcmdance data for students* The first form is for target 

studtMUs; thu second for a comparison sample of students* The following 

data will be provided: 

AtLundance records (days present, days enrolled) for each 
of estlmatcid 250 target atudents In each of two cohort 
samples for 72-73, 73-74| 74^75, and 75-76, Same data for 
n I nontarget comparison student samples in each of the 
live schools, 

C Dt^sign Configuration 

For each of two cohorts within each of five Project Echo test sites' 

Target students i 

Nontarget sample: 0 

where i 

1 - identification as a Project Echo target student; and 
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»' - ioiiecLlon oi sptCifLed nt Lendance daca. 

SampJfH: Target students consist of the Cohorts 1 and 2 samples 
iiitinL f f led above. The nontargat sample consists of all other students 

ot the same age groups in each of the five test schools. 

IK Data Analysis Modal 

projact criterion will be considered to be achieved if each of the 

'undiLlons specified in evaluation question of interest #2 are met. The 

ruplic ation criterion will be considered met if target student absenteeism 

lit^crensL^ by 6% over their past three-year attendance record, 

11* Qg-s ign Implementation 

In each of the five Project Echo test sites, attendance infomation 
was gathered from school attendance recorda and transferred to the 

Proju cc Echo Student Attendance Form (see Attachment 5). To provide the 
tlata needed for analyses » the form requested (1) total days present, 

(2) total days absent^ and (3) total days enrolled for each Echo student 
nnd fOr a compariHon group af students ~ those of the same age as Echo 
Hiudiius but not identified as learning disabled. With the exception of 
CalvuHLon where the comparison group wag randomly sampled from among non-- 
Kcliu ^tudentji (because of the large student population) , the comparison 
groups consisted of all non-Echo students enrolled in each test school* 
ComplciLt! attendance data were collected on the following numbers of students. 



;S i te 


N-Cohort 1 


N-Cohort 2 


N-Coaparlson 


(ialvcsLon 


34 


47 


181 


(iroenv f 1 le 


8 


15 


244 


harcdo 


0 


24 


94 


Piano 


21 


19 


537 


W. Central Tex, 
iiduca. Co-op. 
TOTAL 


42 
105 


26 
131 


644 
1700 



. 24 

Er|c 30 



Data were collected on the 1975^76 IS^-year-'Olds by school year from 
P>72-/l, and from 1973--74 for the 1 5-Yfe*ar-olds » Students who 'ransfcrred 
iiii.i) Mm- L«^si KchoolH tinring chtj baf-u.'lLne period were deleted '.mm 
'M ifiipii t ;a I oji lor LhoHO yuars wht-n nor: cfnrolied. 

.ompuLaL Lona 1 lormulaH are provided in At taclimen t 2, 
Lv.i LuaC i « ill Find Ings 

/A no Lest sitL^ was tht cjbjective that 90% of the Echo sCudonts would 
. ;..-ri. . ...t L!.^j?r rati: of .school attendance by 6% over their prior attendance 
Uintcirv achu^vod. 

The objective that 75% of the target students would increase tlieir 
. i L teritlance by 10% over their prior record was achieved by two Echo st udent 
k-roup,-; ~ the Cohort 1 group in Piano (80.95%) and Laredo Cohort 2 students 
(H3,3i%). AnroBS all sites ^ 69,52% of the 16-yaar^olds and 60.31% of the 
l3^yi^ir--oldH met or exceeded this objectve* Sea Table 5. 

T wo Echo student groups had attendance rates in 1975-76 which exceeded 
tiiat t> t: non-Echo comparison students in the bbmb schools . Greenville 
Cohort 1 students were present for 94.13% of the total days enrolled while 
non^Etho students in Greenville achieved a 93*32% attendance rate. In 
flalvGStonj the Cohort 2 group exceeded the comparison sample in attendance 
by 94.78% to 92*85%. See Table 6. Using the % change formula (Attachment 
2)* the (ireenville and Galveston Echo groups demonstrated, respectively * 
1 2 ♦ 1 1/. and 26.99% fewer absences than did their respective comprnrison 
groups. See Table 7. 

(ialveston 15^year--old target students in 1975-76 equaled their 
attendance rate of the previous 2-yaar pre^Echo period (94,78% 
attundance), but no Echo student group improved their mean attendance 
ratu. See Table 6. 
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ihi' H'aLt^d repllcarFon criterion, based on the tirget group atcendancc 
■ mprovLmont expertenced in Cors leans in 1972-73 j was not achieved by 
.tny I'S-lb Echo group. Across sites, target student attendance races 
Jt'creaHed for both Cohort 1 (93*86% to 92.48%) and Cohort 2 (94.28% to 
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TABLE 5 



PKRCEKTAGE OF ECHO STUDENTS U^ROVING ATTMDANCE IN 1975-76 
OVER PREVIOUS ATTENDANCE RECORDS 





16-Year-Olds Exceeding 






Test Site 


Number 


Percent 




^ i 1 vos ton 


24 of 


34 


70.59 




i>r(^vny \ \ \ q 


4 of 


8 


50.no 




Vl.ino 


17 of 


21 


80,95^ 




t Can L ml Tuxas 
Ivducat Loiial (Inoperative 


28 of 


42 


66.67 




TOTAL 


73 of 


105 


69.52 


- 


(Niliorc 2 


15»Year-01ds Exceeding 


Attendance Ohiectiva 




Tt sL SLte 


Number 


Percent 






24 of 


47 


51.06 




firoenv t 1 Ic 


11 of 


15 


73.33 




Iw! rcdc> 


20 of 


24 


83.33^ 




IM.ino 


10 of 


19 


52.63 




luvst C'entral Texas 
Educational Couparativa 


14 of 


26 


53.85 




TOTAL 


79 of 


131 


60.31 



NOTIIS : 

1 Of' decreaBc in ahsenteaism over previous record* 
^ criterion achieved 
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TABLE fi 

'AF.m pmcFm attendance by ppoject grow and site 



''■<'.sL 



to 



f.'/i I voKtnn 
Crfi'iivil lo 
l.ircilo 

West fJentr.il 
Texas KducaCLonal 
(Jn<ij)t'rat i ve 

TOTAL 



1975-76 
92.72 
94.13 

92.26 
92.08 
92.48 



Cohort I 



1972-75 
53.41 
96.70 

95.12 
93,05 
93.86 



Coh 
1975-76 

94.78 

90.76 

90.12 

94.49 

92.26 

92.92 



ort 2 



1973-75 
94.78 
93.31 
94.56 
95.51 

92.79 

94.28 



■'■on-rc'io 
CoFiparison 
Group 

92.35 

93.32 

90.74 

94.52 

94. 3?: 
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TABLE 7 



PERCENTAGE DIFFERENCE IN ECHO STUDEN T ABSINTEEISM RATI 
COMl^ARm fO ABSENTEEISM RATES OF TWO REFlKKXCE (GROUPS 



Pe f erencu Groups 

Cohort i Prior to jJon^EchQ Comparison 

Echo, 1972-75 Group, 1975-76 

Cohu r I _l 

(;aix/u^tun 10.47 1.82 

finMmvillc 77.88 -12.13* 

Piano 58.61 al,24 

West Central i exas 14.12 '*0*4j 
EducaC lonal Conperat ive 

TOTAL 22.48 23. 28 

Reference Groups 

Cohorc 2 Prior Co Non-Echo Comparison 
EuhOt J,9 7 3^?5 _ Group , 1975-76 

Coho rt 2 

Galvusion 0.00 -26.99* 

(ir.-i-nvillf 38.12 38.32 

Lart-do 81.62 6.70 

Piano 22.72 0.55 

WcHt Cimtral Texas 7.35 37.23 
Educational Cooperative 

TOTAL 23.78 16.07 



NOTES; Negative percentages indicate Echo student absenteeism rate was less than 
that of Reference Group, 

Asterisk (*) indicates achievement of evaluation criterion. 
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KECTIfK: '1 
STUDENT IIROPOUTS 

=\ ♦ Dui' Stion of Interest 

Do high school students who are exposed to Project Echo in aach of 

! ivc ivKaB ^(iGondary schools meet the following expected outcome: 

TIiu rate of dropouts among thu target students will be 2% 
luHs th.in the dropout rate among students of the same age 
groups in each school over the previous two years? 

Instrumentation 

i'rojcct i£cho Dro pout Da ta-Gathering For m — The following data are 
nrovidvdi in each of five schools for the 75^76 school year^ number of 
larguL-group dropouts, number of target-^group enrollees, n™ber of non- 
largt'C dropouts, and number of nontarget enrolleas; and In sane schools 
tor 72-73, 7 3-74^ and 74-75 ^ number of dropouts and number of enrollees 
in thf Hamu age range as Project Echo target students. 
Design t'u n^iguratlon 

For each of two cohorts within each of five Projact Echo test sites 

InrgeC students: ^0^^ 

Nontarget sample: 0 

where- : 

J - identification as a Project Echo target student; and 
n ^ (iillecilon of specified dropout data. 

S.imploHt Target students consist of the Cohorts 1 and 2 samplr^^ 
idenLiiiofl .ihove* The nontarget sample consists of all other students 
of Llh- Hamt* age groups in each of the five test schools. 
II. Da ta Analysis Model 

The pro iect and replication criteria will be met by achic v.jritn: of 
27o decrease in dropout rate as specified in evaluation question oi inifetr 
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'iins [Mirtlon of thi- Project Echo evaluation dL'sign was noc fully 
implcin. !itu<] as originally proposad. An unancicipated problem encountered 

thai ovnilabb' school records in heveral inscances did not pertnit 
n isr inHuishing, with confidence in thy data, actual school dropouts from 
wudrnis LrMnsfcrring to otlier schfjols. This was particularly common with 
"ult.h'r" reif)rds. Lack of uniform follow--up procfedMres among the sicts when 
a stuth,ait \i/tt school for unknown reasons resulted in some data of cuastioii'- 
able validiiv. Findings which are reported were based on verifiable 
tjnrollmcnt and dropouc figures for 15=year-olds at four of the Echo 
(est siLes, Data which were eraployed included total populations for 
1973-76 and 1974^75 and both Echo and non^Echo groups for 1975-76, Dropout 
data un Laredo 15^year-olds prior to 1974-75 were loat in a 1974 school fire. 

Sufficient data were available to perform dropout comparisons against 
two reference groups rather than one as originally proposed. These 
rt-ference groups were (I) all 15-year^olds in each site over the previous 
2^year period, 1973-75, and (2) non-Echo 15-year-olds in each site during 
the Implementation period, 19 75-76, 

For each student samples the percentage of dropouts from the total 
t'nrollment was computed. In addition, the percentage diffarance in dropout 
rates hetween the Echo group and the non-Echo comparison groups ware 
iluturmined. Computational formulas are provided in Attachment 3. 
V * Lya 1 ua t i on Find ings 

Ki f teun-'year-old Project Echo students dropped out of school less 
iruquHntly tfian did eittier (1) all 15-year-old students enrolled 
in project schools during the 2 years prior to Echo implementation, or 
(2) non— Echo 15="year=olds in project schools during the implementation 
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pi^rimU AiroHH sitt's, eight oT 1^9 Echo students (5.03%) left school 
.Hid tjitl iui\ enroll i^lHrwlwrv fiurinj^ 1975-76* This dropout percGntnga 
^'ttm\):\n :. l.ivi»rai)ly to t ho dropDut [.yrcunLages of the two referGnce 
>^roiij)ri nieni i<»nt^d ahovt', which wutq 6,35% and 6,05%, rsspectivelv . See 

WfuTi the p^rcuntage dif f t^renc*.: in Echo student dropout rate was 
compHrc'd to the dropout rates of the two non^Echo groups , the Echo group, 
an a whole, demons trat:ed a dropout rate 20*79% less than the dropout 
porctaitage of all 15^year^olds , 1973-75 SMiplej and 16.86% lass than the 
dropout percuntagcj of non-Echo students during 1975-76, Most of this 
dLffurence was accounted for by the Echo group in Galveston, none of whorn 
firopped out of sciiool during the implementation period* See Table 9, 
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TAaLE 8 



STUDE^a' DROPOUT DATA SIM^RY BY GROUP AND SITE 





Echo 15-Yr.-01da, 

1975-76 


Non-Echo 15- 
Yr.-Olds, 1975-76 


■ All 15-Yr.-01ds, 
19 73-75 Avijrago 








(*alvcsLon f 
Kiiro lime lit 


48 


1023 


___________________ 


No. Dropuuts 


0 


64 


58.5 


% DropoutH 


0.00 


6.26 


5.90 


I,art'du j 
i'itiroi Init-nL 


43 


207 


544 


N(>* DrupuuL.s 


5 


25 


57 


"I DrupoiiLH 


11.63 


12.06 


10.48 


Enruilmunt 


35 


466 


242.5 


No. Dropouts 


2 


26 


14 " " 


% Dropouts 


5.71 


5.58 


5.77 


Wc*Bt TcrxaH Contral 

lid u ca L I ona 1 C o o p u r a t i vu 

Kiiruilmunt 


33 


403 


410.5 


No, Dropouts 


1 


12 


&.5 


X Dl^OpOULd 


3.03 


2. $8 


2.31 


TOTAL 1 " " 

K nrollmunc 


159 


2099 


21S9 


No, Dropouts 


8 


127 


139 


% i^ropoutH 


5.03 


6.05 


6.3S 
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TABLE 9 

PmCENTAGE DIFFERENCE IN ECHO STUDENT DROPOUT MTE 
COOTARED TO DROPOUT RATES OF TWO NON-ECHO REFERENCE GROUPS 

Reference Groups 



Non^Echo 15-Yr,-01ds, All IS^YrZ-OldsV 
1975-76 1973-75 



iCCiiO GrQups 

GalveBton -100*00* -100*00* 

Laredo --5.44* +10.97 

Piano +2,33 -1,04 

West Central Texas +1,68 +31,17 
Educational Coopefatlve 

TOTAJ. -16.86* -20,79* 

NOTES I Negative percentagas indicate Echo student dropout rate was less than that 
of Comparison students « 

Asterisk (*) indicates achievement of evaluation criterion. 
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SECTION 4 
PARENT INVOLVEMENT 

A, Question of Interest 

Do 80 pereerit of the parents of Identified Project Echo target 
Htudents In each of five schools attend 80% of the project's scheduled 
parent involvement activities during the project implementation 
puriod? 

B , InMtrumgn Loti on 

P^nrent Lnvolvement Activity Register ~ The following data are 
provided: Kor each of five schools » number of parents of target students s 
nurabdr of pltinned parent Involvement activities , and number of parents 
of target students in attendance at each activity. 
Design Configuration 

For each Parent Involvement Activity at each test site: 

X 0 

whurc* I 

K ^ planned activity * and 

0 - collection of attendance information. 

Var this section of the design, ''parent attendance" is defined as the 
physical presence of one or more adult members of the household in which 
a target student resides, 
0* Data Analysis Model 

The project criterion will be met if 80 percent of the target students* 
parents attend 80 percent of planned Parent Involvement activities. No 
rap ligation criterion will be applied. 
K, Denlgn Implementation 

Evaluation question of interest #4 was predicated on the asiumption that 
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iuiiU nnl Hi to would c-uiuluct, clurLng thv prc-lraplementauion period (whtm 
•H'nM-iiing /ind appraJgal was ronductc'd) and during the ImplOTuntatlon pc-rlod 
rwhuM Hclio materlnlH were used with Identified target students), a series 
of group activities (meetings > information session, etcO for parents 
of thoHe students identified as learning disabled and enrolled In the 
project* The anticipated series of group aetlvltles did not occur at 
each Hite* The general pattern for conducting parent involvement activities 
wdH ti> conduct one general Information session for parents early In the 
projuct and followup with periodic individual parent contacts during 
the fichool yuar* This modification of the parent involvement Implementation 
plan wan suggested and approved in a meeting of Site Coordinators and the 
Project Echo Advisory Comittee (August 12, 1975), The rationale for the 
change was that individual parent contacts would provide a more effective 
approach to communication with parents of target students than would large 
group sessions. Only Laredo and Piano conducted more than one general sessioni 
nalveston used only Individual contacts. Because of the modified approach 
to p arent Involvement activities, this portion of the evaluation design 
could not be mplenented as originally proposed. Other data, which were 
available, do provide indicators regarding the effects of parent involvement 
activities. The data are discussed In the following section, 
F* Evaluation Findings 

All Project Echo test sites reported contacts with at least one of 
the parents of every identified Projec t Echo target student in 1975«76, 
At the mlnimOT, these parents were provided a description of the project 
and its goals, inforaation about learning disabilities, and ipecific 
feedback regarding the process deficits identified in their child during 
the extensive pra-toplementation screening and appraisal process. Most 
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pare^nCH weru provided information about the academic progress of chuir 
uliild during t\m course of the implumentation period. Most contact?^ 
Ixawotn KcUo Htaff mambtirs and parents were by telaphona (approximately 
nnu--Lfiird of which were eetlMted by Site Coordinators to have been 
parents-initiated calls). Individual parent conferences were the next 
most frequent mode of contact ~ followed by parent attendance at a 
planned group meetings 

Four sites had at least one general meeting for all parents of Project 
Echo students. Attendance figures werei Greenville, 34 parents attended 
one meeting; Laredo, an average of 27,2 parents attended five meetings; 
Piano* an average of 17*2 parents attended six meetings; and West Central 
Texas Kducational Cooperative , 39 parents attended one meeting* In Laredo 
and PlimOj where multiple group meetings were conducted, the largest parent 
at tendance at any one meeting was 53 and 50, respect ively. 
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SECTION 5 
C0W1UN1TY INFORMATION DISSE4INAT10N 
A . Qu u Htiun q£ Interest 

Do reprosentativas of buslntss fittm and civic organisations in each 
of the five Texas conmunitias in which Project Echo Is Implaaented attend 
onu of two project infonflaclon dlsseninatlon conferences conducted by the 
Local project staff? 
ii. jriH trumfentatlon 

Prolect Echo DlEaamlnation Conference Register — The following data 
lire providL-d: Records of the occurrence and attendance at information 
d iHHumi nat Lon conferences conducted for representatives of buslnaig and 
civic organizations in five comiunitles. 
i: , Denlgn Configuration 

For eacfi Dissemination Conference at each test sitei 

X 0 

wheru i 

X ^ Dissemination Conference; and 

0 = collaction of attendance Information. 
I). Data Analysis Model 

The projegt^ and rap 11 cat ion criteria will be achieved if two Dissemination 
Conferences are conducted. 
Il, Design Implementation 

Project Echo information dissemination conferences were conducted at 
three of the five test sites. In Galveston and Piano, local school 
administrators preferred not to conduct such conferences because of 
uncurtalnty about the district being able to continue support of the project 
after the 1975-76 school year. 
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. Uvn 1 ua 1 1 on F 1 nd 1 ng a 

The project mid replication criteria wars aehleved at the thre e 
Kcho^ j.c'Ht h1 tus which elected to conduct information dlsSBmination 
iimturvnQCH for rapresentatlvea of local bualneas flrmg and civic 
o rganizatio ns. In these sites, a total of 33 seaaions were conducted 
In whli'li 1,158 Individuals were provided InforMtlon about learning 
djsabi I itlcH, Project Echo, and the local school dlatrlct's participation 
In the project. See Table 10. 

In addition to the provision of Project Echo Information via these 
confercmceB, the local newapapera at two sites published feature articles 
regarding Project Echo for their readers* 
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TABLE 10 

OCClJimFNCR OF ATTENDANCE AT INFORMATION DISSMINATinN 
CONFERENGES CONDUCTED AT THREE PROJECT ECHO TEST SITES 

Number of Total Average 

Sessions Attendance Attendance 

Tc'St Site 

Greenville 8 313 39,12 

Lartido 10 252 25.20 

WeHt Cuntral Texas 593 39.53 
Educational Cooperative 

TOTAL 33 1,158 35*09 
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SECTION 6 
TEACHER TRAINING 

A. Qut^stlon o f Inte rest 

Do clasHroom teachers who Implement Project Echo instructional 
Minlmodulas in five schools demonscrata attainment of the concepts 
presentod in the Process Orientation Modules? 
Inn t rumenLatl Qn 

Process Orientation Mo^dule C^rlterlon^Referenced Measures — instrifflients 
tluHignvd to determine attalraent of concepts presented In the teacher 
orientation to Project Echo. 
(J* OuHlgn Conf Iguratjpn 

Within each project test sltei 

X 0 

wiiure - 

X ^ exposure to process orientation modules^ and 
0 ^ assessment of concept attainment* 

The sample consists of classroOT teachers of identified target students 
who uHu Language Arts, Mathmatica | and/or Science Mlnimodules in five 
Texas schools* 
I). Datt] Ana] y sis Model 

The project criterion will be met if project teachers denons trace 
attainment of an average of 80 percent of module concepts presented* Thfcre 
is no replication criterion as the process orientation modules were noc 
L*mployed in the pilot test site, 
l*^ * Design Implementation 

At none of the Project Echo test sites were the Process Orientation 
HoduleH used with Echo teachers as they were designed to be used. The 
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iiMiHi |>ri»val«'nl ruaHDn w.-in the amount of timr required for complete 
iiiiji h iiMMif ni inn, 

OiirinH Lhr .srjrJng of I97'i, prior to the use of Echo materials in the 
rl/jHHroom, all teachers who would be uaing the raaterlala were eKposed to 
imrUans of the training modules. Since the complete modules were not used 
the PrDject Training Coordinator elected not to administer the Criterion- 
Kefercmced Measures as originally planned. 
Evaluation Findings 

As previously indicated, the Proceas Orientation Module Criterion- 
Kuforunced Measures were not administered at any teat site. No data are 
,'ivailable from other sources to indicate teacher attainment of concepts 
presented In the modules. 
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SECTION 7 
PROJECT ECHO DISSEMINATION 

A* Qiii's t jpn uf InlCfrost 

IJo admlriistratora nnd/or supervisors from the 25 observtr ieheols 
domonst rate comprahension of Information regarding the components and 
operaLlon of Project Echo as implemented in five schools^ whleh ii 
c'onalderad by the Project Director as information useful as Input into 
the decision to adopt the modal during 76^77? 
IK I ns t rime n tat ion 

These process data will be collected by Infomal interview with the 
Project Director, » 
C. Design Configuration 

The interview will be conducted prior to May 31 ^ 1976, 
I), Datn Analysis Model 

ProcesH data will lie documented without apecific identification of 
ohNerver schools. Criterion will be achieved if one administrator or 
Hupervisor from each observer school is considered by the Project Director 
to comprehend operation of the Project Echo Model* 
Ji* Design Implementation 

To test the dissemination strategy that potsntlal adopters of a complex 
product (i»e.. Project Echo) are morm likely to decide to adopt that product 
if their Information about the product is based on personal observation ^ each 
of the five Project Echo test sites was asked to identify five other school 
districts or cooperatives to observe the implementation of the project. 
The obHerver schools that were identified by the five Echo sites ^re 
indicated in Table II, 

Representatives of observer schools were provided the opportunity 
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to viHit thi' respective Echo teat sites in order to obtain an overview 
ul lIh* proJiM'tj axamine the materials, obBerva use of Echo products and 
prtiridiirt's in a claHsrocjm settings and question local project staff 
iric'inbt^rH about the project* 

Infomation regarding this portion of the evaluation was obtained 
in inLfe*rviewB with the Echo Project Director on May 17 and June 14 and 16, 
1976, Supplementary data were obtained via a Site Coordinator Debriefin p 
inBtrument completed by each of the five Site Coordinators in June 1976. 
1* Evaluation Findings 

At least one representative from each observer school visited an Echo 
toHt Hlte at least once between February 1976 and May 1976. Many 
rL'turnud for a follow-up observation ~ often bringing other persons from 
I heir school district. 

M«)Ht rrtiqentlyj thu observers were either Director.^ uf Special Education 
iar thiMr district or high school principals* Other observers included 
School Supur intendents i School Board members , Curriculiffli Directors ^ Secondary 
TeacherHs and Educational Diagnosticians. 

In a scries of interviews near the end of the project, the Echo Project 
Director expressed the feeling that 80-90% of the observer school 
roprcHrnCar i ves had obtained sufficient understanding of the project on which 
^iLJ?jL^i* an ndopt ion-decision. The reiralnlng observers were considered 
lo havt* a good understanding of the instructional materials , but did not 
I ully ( omprehend the purposes or operaCion of other Echo coc^onents e^g^j 
the Instruct Lonal management system and the screening and appraisal process. 
Wrlttt*n comments of the Site Coordinators in response to items in a Site 
(loordinator Debriefing instrument verify these observations. 
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TABLE 11 

OBSERVER SCHOOL DISTRICTS SELECTED BY ECHO TEST SITES 



Ob B c r V G r s at G a Ives ton I SD t 
Alvln ISI) 
Beaumont ISD 

{'tuoBe Creek ISD (Baytown) 
I.a Marquu ISD 

Spring Branch ISD (llouston) 
Tixas City ISi) 
QbHorverH 1 1 1 Larodo ISD> 
JirownHV i lie ISD 
Edinburg ISD 
MerceduH ISO 
Wt*Hlaco ISD 
Zapata ISD 



Obsorvera at Greenville ISDi 
Conimerce ISD 
Denlson ISD 
Irving ISD 

Red River Cooperative 
(Clarksville) 

Wylic ISD 

Observers at Piano ISD_: 

Carrolton-Farmers Branch ISD 
Denton ISD 
Garland ISD 
Richardson XSD 
Sherman ISD 



Qbservers at West Central Texas Educational Cooparatlve 
Abilene ISD 
Divide ISD (Nolan) ^ 
Hermleigh ISD^ 
Lorraine ISD^ 
Snyder ISD 

NOTES: 

^HalveKton ISD identified six observer school districts* 

5erB of the West Central Texas Educational Cooperative, 
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ACTIVITY AUDIT 

^ • ijlJ Ji^itiQn of Inleregt 

Does an evaluation audit of the project Implementation (intervention 
and roplication atrategies) in five achools Indicate that the following 
activities and procesees were accomplished as anticipated i 

a. The pupil screening and identification process? 

b. Use of instructional support materials with identified 
L/LD students? 

c. Observation of the operation of the L/LD model by 
repreaentativas of the cluster associate schools? 

cJ* The adoption^decislon process in the observer schools? 

e. Development of a statewide plan for dissemination of Information 
about the model to all Plan A schools? 

Instrumentation 

These audit data will be collected by inforMl Interviews with specific 
personnel associated with Project Echoi the Coordinator at each of the 
five test sites (questions a-c) , the identified administrator or supervisor 
from each of 25 cluster associate observer schools (question d) , and the 
Project Director (question e). The interviews may be conducted during 
site visits or by telephone, 
C* Design Configuration 

The data collection schedule may vary In different sites. All data 
will be collected prior to May 31, 1976, 
D* Data Analysis Model 

Occurence of each of the processes identified in evaluation question 
of Interest #8 will be considered as attalmient of criteria. 
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jj< ' iaJL > i»ir 1 cmun La 1 1 on 

PrnjiM'i Kc'lu), In nchlitlon Lo prnviding a triril of aupplcmcntary 
iiislruf i innni inali rinls (It^Hlgned for uhu with scicondary learnirig 
'lisabhd sludcjnt.s* affordud an opportunity to Implement Beverai non- 
inHtruc't ionai Intorvant ion and replication etrategles* This portion of the 
[irojcrt ovaJuatlon provides an audit of several activitiei which were 
!)lannc»d to occur in conjunction with the project. 

Various audit data were collected in meetinga and during on=site 
nnd/nr teluphone Jntarvlews with a large nimiber of project participants > 
including tho Project Director, membera of the Project Echo statewide 
Advliiory Committees all Site Coordinators and Echo teachers and aides , 
lour of the five superintendents at the Echo test sites * all test site 
principals and Special Education directors, and famples of Echo target 
HtudontH and observer school representatives • WritCen feedback from the 
Site CUjordinatbrs was available via a debriefing instrument which the 
Coordinators compJetad in June 1976. 
E va 1 uat ion Find Inga 

Screening and Appraisal. In all five Echo test sites, a screening and 
. ippraiHal process was conducted to identify groups of learning d is ab 1 e d 
sLudtrnts with whom the Echo instruction m aterials would be used. Cohort 1 
.students (16^year-olds In 1975-76) were identified during the spring 
semester of 1974-75 — at which time they were 15-years-old, The Cohort 2 
groups (15-year-olds in 1975-76) went through the screening and appraisal 
process early In the 1975-76 school year. 

The process as designed and implemented was a multistage effort which 
sought to identify those students who fell within guidelines specified by 
the Texas Education Agency to define a learning disabled student (Administra- 
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L ivo Guide and Handbook to Special Education , Bulletin 711)* The first 
Htage of the process, screening, Involved analysis of data on all 15-year- 
nldB In each test Hrhool to idGntlfy those students with possible learning 
di'flcItB. This idontifled subgroup then received In-depth appraisal (s) 
in Chn dcflcLt araa(s) indicated by the screening. Those i^iose learning 
defrc-iiH were verlflad by the appraisal provided the target student groups 
fur l2cho intervention. 

The screening and appraisal process, as implemented to identify Cohort 
I students^ was quite elaborate (See Attachment 4), An attempt was made to 
make operational a standardized procedure for Identification of target 
students. Primarily because of the time required for complete implementa- 
vlon and resulting scheduling conflicts, the screening and appraisal proces 
was streamlined before the Cohort 2 groups were identified. This was 
goneraJly accomplished by use of some assessment Information already 
contained in school records (rather than administering additional 
instruments) and through a teacher referral process. 

Use of Instructional Materials, The Language Arts and Mathematics 
minimodules were used more extensively with target students than were the 
Sclencn minimodules ^ Reports from Echo teachers and Site Coordinators 
indicate that the Language Arts minimodules are more easily integrated Into 
the normal Language Arts curricula presented to ninth and tenth grade 
HtudentH* Suveral target students were enrolled in Algebra classes^ and 
the Mathematics minimodules (designed to supplCTient a pre^algebra general 
math program) were of limited use to those students. The Science minimodule 
wuru duslgnud for use with students in Physical Science curriculum; however 
/ilmost half of the target students were enrolled in Biology and did not 
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xmo any of LiiG Science minimodules . 

The ICcho minimoduleH were more frequently used with Cohort 2 sLudents 
n 'S-yi ;ir=nldsj thnn Wi th the 16-year-old Cohort 1 students. Many of the 
n\di.r studrmts wvrtj carolled in classes for which mlnlmodule content was not 
clirijCLly applicable. In Laredo, no Cohort 1 students were exposed to the 
Krho minimodules during 1975-76, In that district, ninth and tenth grsde 
-audenLs att.-nd classes on different campuses. Resources were not available 
In implcjment Echo at both locations, so the decision was made to focus all 
i^r forts on the 15-year-^oids , the age group for whom the laaterials w^re 
'>riginally designed. 

The differential extent of use of the minimodules across the five 
*>-st sices is difficult to assess. The subjective impressions of the 
Hfojcjct Director and Project Evaluator, who visited all sites on multiple 
(iccasions, were that the greatest extent of use was in Laredo and the least 
in Piano. 

Ischo minimodules were used in a variety of instructional situations 
Lhu most prevalent pattern was use with a small group of students In a main- 
stream classroom with the Echo teacher assisting the mainstream teacher. 
On occasion , the entire class — both Echo and non-Echo students — used 
the materials. Some individual minimodule use in a resource room setting 
occurred ~ particularly in Colorado City and Galveston, 

Observation by Cluster Associates. As Indicated In a previous section 
(pages 47-48) representatives of observer school distrlcta (Cluster Associates) 
did i nvestigate Project Echo by observing project operations in the test 
HchocUs . Site Coordinators provided several means by which observers 
could obtain Information about the project. These included Invitations 
to obHtTve the materials in classroom use, to attend training sessions 
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piovichd Id u»hL MiLfc mrunwcrram C(*achars, to view a slide^Cape Project Echo 
*»vervivw, to review Echo products, and to participata in cuastion-and- 
answer sessions with Echo teachers. Two sites prepared periodic newsletters 
.ind drscrlptive correspondeace for their observers. Presentatioaa wore 
made of observ^er school sites by two Echo Site Coordinators* 

A doption-Decision Process. As of June 1976 , some considergtioii 
rrgan 1 J ng th u possible 1976-77 adoption of all or part of Project Echo had 
u< curri d in all observer districts. Of the 26 observer groups , 12 had 
indics;iLt-d a decision had been reached — 11 in favor of adoption and one 
rfjecLion. The remaining 14 were undecided at that time or had mixea 
rtjGlings about various components of the projact. General reactions of 
ubservc>rs wt>rt^ strongly favorable views regarding the instructional rsini- 
modules and parent Involvement effects, with least favorable reaction regard- 
ing the Project Echo screening and appraisal process* 

Siatewlde D'issCTination Plan. In June 1976 ^ a proposal seeking funds 
tor Project Kcho dissemination activities was prepared and submitted to the 
Bureau of Education for the Handicapped by Education Service Center, Region 
XII, in Waco. The disposition of this proposal is not currently kno^^m, 

Surficient quantities of the final revision of the Echo Instructional 
materia Is are being prepared to provide copies to all Echo test schools » the 
observer schools which desire them, and all 20 of the state's regional 
Kducation Service Centers, Materials in the Service Centers will be 
available to school districts on a loan basis. 

No coordinated plan for craatlng Project Echo awar eness among potential 
adopters has been implemented- however, several independent efforts have 
occurred — e.g.* a preaentation at the convention of the Texas Council 
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lor Kxt/uptlurial Children (Houston, July 1976) and a feature article in 
I'oncor 1 oLD , n monthly publication of the National Learning Disabillcies 

Assi s t ance P roj act * 
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SECTION 9 
INSTRUCTIONAL CONTENT MASTEKY 
A . Quu stion Qflntarest 

For each of 30 Project Echo instructional minlmodules , do 80 oercent 
ot target scudants, after eKposure to Che project intervention, demonstrate 
mastery of 80% of the major instructional objectives addressed by the 
m i nimodules? 
B- I n H L r ume n t a t i o n 

MinimodulG Mastery Tests ~ a series of 30 cr iterion-^ref erenced raeasuress 
^ rich dt.'Hignud to tust student mastery of the major instructional objectives 
^if onu of the 30 Project Echo minimodules* The series contains 10 
I.ingungt^ arts tests, 10 mathematic?: tests, and 10 science tests. 
. Design ('onf igurat ion 

Kor each target student: 

KiOi, X2O2*... ,X„0^ 
where : 

K ^ student exposure to one of a series of Instructional minimodules; 
and 

O = nssessment of objective master, 

Sample: StUilent samples consist of all identified target students who 
arc exposed to one or more Project Echo minimodules. 
U - Data Analysis Model 

Correct responses of 801 of the target students to 80% of the items of 
each Mastery Test will be considered indicative of mastery of the major 
instructional objectives of that minlmodule. In addition to the basic 
analysis models mastery test findings will be analyzed by student age group, 
Hex, ethnicity, and test site to explore and document any possible mastery 
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il L f ftirunces within these target student subgroups* 
1 i - pes i gn Implegantatlon 

The 30 Project Echo miniinodules — 10 each in the areas of Language 
Arts, MathemaC ICS J and Science — were made available in five test sitas 
lor Kiipplenientary instructional use with identified learning disabled students* 
I'ach uf the original minlBBodules was designed with an accompanying criterion- 
ruferunced Mastery Test for post^instructlonal atoinlstration to assess 
Ktudent attainfflant of the major Instructional concepts presented. Three 
of thii 30 test instrments were judged by external reviewers to be in- 
adequate measures of mastery and were deleted from the version of the mmCerlals 
tt/stud in 1975^76* Data from the remaining 27 Instruments were collected 
Ln provide Indicators of the effectiveness of the mini^odulea in trans'- 
mitting instructional content* The primary purpose of the data collection 
was to provide formative information for a final revision of the minlmodules 
prior to the end of the project's funding period. The primary analysis 
procedure was determination of the proportion of target studetits 
rcopondlng correctly to each item of each Mastery Test, In that manner ^ con= 
cepts not atcained after instruction (l^e,, items missed by a large 
percentage of students) could be Identified and the corresponding content 
in the minimodule strengthened or clarified during revision. 
- E v a 1 ua t i on F 1 nd 1 ng a 

Analysis of ^ha Echo Mastery Test data was quite involved. Over 20,000 
pieces of data were received. Prior to sumarlzing the general findings, 
two major cautions are advised: 

• Becauae final revision of the mini^odules began prior 
to the end of the i^lementation period, analyses of 
Mastery Test results often were conducted based on data 
available at the time the revision of a specific mini- 
module began. Mastery tests subsequently received from 
that minimodule were not included, 
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• In many instances the minimoduLes were used in mainstream 

class rooms with both Echo and non-Echo students. When Mastery 
VeBts were administered to both groups^ teachers were 
[nstriicted to return both sets for analysis (to provide an 
indiciClon of utility of the materials for a group other than 
Che (mo for which the matarials ware designed)* Some Mastery 
TiiHtH werti received for which gr^^p designation (Echo or non^ 
Kcho) could not be distinguished. These data were omitted from 
analysis. 

Arross riites. Mastery Test results were greatly divergent. A minl^ 
mfidulM wliich had positive effects in one site frequently fared less well 
in annLher location. Minimodules indicated to be most successful vera: 
Langun^e Arts IV, V, VII, and X; Mathematics I, II, IV, and V; and Science 
fir, fSee Inbles 12-14, in the following saction) . 

As prevLOusLy indicated, three minimodules did not contain Mastery 
Tests; rheHf' were 5'cience V, IX, and X. Data from three other mininiodules 
were not analyzed because of the samll ni^ar of students (less than 15) 
who wtrre exposed to the minimodule and who cOTpleted the Mastery Test. The 
deleted minimodules were Mathematics IX and Science II and IV. 

Trends in tho data were not strong enough to suggest any significant 
mastery differences as a function of student age, sex, or ethnicity. 
Pnrrormance differences on specific minimodules were frequently noted 
between Sites, but no strong patterns were lucated when data were examined 
across minimodules. 

Consideration of Mastery Test findings In conjunction with data 
obtained via the Teacher Checklist (reported in the following section) 
reverb I s that the most effective minimodules tend to be more positively 
rated by teachers and to have received more pupil exposure time (mean 
expoHures of 4.38 hours per student vs. 3,83 hours per student). 
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SECTION 10 
TOCHER PERCEPTION 

f-fjl3owing classroom use of each instructional minimodule with at 
h'/ist f ivti students, do 80 percent of Project Echo teachers report that: 

a. a majority of the students demonstratad interest 
in the minimodule content? 

b. instructional time requirements were not excessive? 
preparation ttae requireoents were not excessive? 

d, the quantity of materials and media provided was sufficient? 
the quality of materials and media provided was appropriate? 

f. the mastery test provided a valid indication of student 
learn i ng? 

g. the instructional objectives of the minimodule were appropriate 
to the educational needs of ;LOst of the students? 

h. the vocabulary and reading level of student books was at 
an appropriate level for most of the students? 

H- I n 8 1 r um e n t a t i o n 

Tc-acher Checklist — a short form, employing a checklist forma t ^ design 
to obtain teacher reports and perceptions regarding the use of Project Echo 
minimodules. Provision is made to allow open-ended teacher coffiments and 
suggestions for minimodule improvement. Completion of the cheekllst is 
anticipated to require 2-5 minutes for each minimodule used. 
C . Design Configuration 

For each Project Echo teacher? 

where i 

X ^ use of one of a series of Instructional minimodules with five or 
more target students; and 
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n - lomplt't i on ol Teacher CfiGcklist . 

::.implt^: Tvnriwr Hample consl>itK of all Projc^cc Echo clasfiroom 
^i^tl/nr roHcjiirce ruom) teachers who use one or more minlciodules with fi\^e 
n r more t a r g u t students, 
D. Data Analysis Model 

Affirmative responses of 80 percent of the teachars using each ProJ^H't 
i;cho minimodule to Teacher Checklist iteffls addressing each area of 
concern identified in question of interest #10 will be considered as 
/I t t a i nma n t of cr i t ur ia * 
Uc/sign Imglemen ta tlon 

Teachers who used Project Echo minimodules were request ad to complete 
>f iunriiijr ChuckliHC after conipleting instruction with each minimodule* The 
forms requoHted both objective information (e.g, ^ the amount of ceacher 
preparation time required before classroom use) and subjective impressions 
uf the teachers (e.g,, perceived quality of minimodule materials). In 
additions provision was made for unstructured teacher comments and/or 
suggestions regarding the minimodule. 

As with the collection of mastery data, this portion of the design 
w.iH implemenLud primarily to obtain formative Information for use in final 
ri^visJon of the minimodules. For this reason , teachers were urged to be 
eritieal of the materials so that the minlffiodula revision team would be 
provided information about the relative strengths and weaknesses of each 
m inimodule . 

Echo materials were often used in mainstream classrooms by non-Echo 
teachers. Moat of these teachers completed a checklist for each minimodule 
used. These data were separately reported to the revision team for formative 
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purposes but are not included In this report. Teacher checklist d&za arg 
likewise not reported on three mlnimodules which were used with fewer 
than 15 students each. These are Hathematlcs IX and Science II and IV. 
Evaluation Findings 

Echo taachers were generally positive in their perceptions of che mini- 
mudules. Of the 27 mlnimodules Judged by the teachers, 26 received high 
marks for the quality of the materials and 21 were considered as using 
vtjcabulary at an appropriate level for most of the studencs. The teachers 
were U^ss well pli>ased with the app ropr inteness of the Instructional 
nhjectjves for the needs of the studonts. Only 14 of the minimodules had 
objectives which were considered appropriate by 80% or more of the teachers, 
iiiritu minlmudulea Language Arts VII and X, and Mathematics IV were 
rated highly on all eight dimensions on which teachers were asked to provide 
judgments. At the other extreme, the Mathematics VlIX mlnimodule rated 
iiighly on only two of the eight dimensions. Specific findings by minimodule 
and objective are contained in Tables 12, 13, and 14, 

Table 15 summarises teacher percepclons by subject area facross 
minimodules) regarding each of eight dlmensiona of concern* Application 
of the predefined evaluative criteria Indicates that the Lanpimge Arts and 
Ma thematics minimodules each achieved criteria on six dimensions* Criteria 
were achieved on thr ee dimensions by the Science minimodules. 

Other data from the Teacher Checkllste provide several interesting 
observations. More students were exposed to Mathematics minimodules, but 
more average instructional time was devoted to Language Arts mlnimodules, 
Teachors reported much greater teacher preparation time required for use 
of the science mlnimodules. These data are sumari?.ed in Table 16, 
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pj - HOZ ot Luachers report satisfactory pupil 
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(I - H07. of Lcjachers report that Instructional 


time 


requiramants 


were not 


excessive 





I) - 80% of Lt»achors report that quantity of materials was sufficient. 

!■; - HOZ of Leacliers report that quality of materials was appropriate. 

F - 80% of teachers report that mastery test was valid indicator of learning. 

(; - ml of teachers report that instructional objectives were appropriate to 
student needs. 

11 ^ 80% of teachers report that vocabulary level of student text wa^ appropriace. 

L - 80% of teachers report that reading level of student text was appropriate. 
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A 
H 
C 
I) 



Key I u 0 bJecCivQB 

80% of students will demonstrate mastery of 80% of instructional objectives. 

80% of teachers report satisfactory pupil interest in minimodule. 

80% of teachors report that instructional time requirements were not excessive. 

80% of teachers report that quantity of materials was sufficient, 

80% of teaehers report that quality of materials was appropriate. 

80^ of teachers report that mastery test was valid indicator of learning. 



80% of teachers report that Instructional objectives were appropriate to 
student needs p 



II - 80% of teachers report that vocabulary level of student text was appropriate, 



I - 



80% of teachers raport that reading level of student text was approp.riate. 
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(Insufficient data availahla for analysis due 
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(Insufficient data available for analysis due 
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H()% of Htudents will demonstrate mastery of 80% of instructional objectives, 

80^ of teachers report satisfactory pupil interaet In minlmodule* 

HQZ of teacfiors report that Instructional time requirements were not eKcessive. 

80% of teachers report that quantity of materials was sufficient, 

K - 80% of teachers report that quality of materials was appropriate, 

K - HOX of Leachers report that mastery test was valid indicator of learning. 

Ct - 80% of teachers report that Instructional objectives were appropriate to 
Htudeni needs, 

li - 



80% of teachers report that vocabulary level of student text was appropriate, 
- Hm of teachers report that reading level of student next was appropriate, 
Minuiuidule did not contain Maatery Test 
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TABLE 15 



SUhmRY OF TEACHER PERCEPTIONS RHGARDING UCHO MINmODULl 



Echo MlnlinQdule Contcnc Are as 
Language Arts Mathemacics Science 



1 1' ' [ o r T y a c h c r_s Rep Q rj_i pgj^ 

I,) Pupil inLefusL perceived as 
"^idequ/ite'' or ''high" 

^..) instructional time required 
was "tiliouc right'' for most 
H 1 1 id en t H 

'^.) Ouantitv of matarlals included 
w/iH "nbout right" 

4.) (,)uaiiLy of materials was ''adequate'* 
or "exroilent" 

"h.) MaHtery ccst was "adequate" or 
'% xcolli^nt" 

ft*) I iiH true 1 1 onal objectives at 
"appropriatu" level 

7, ) Vucabulnry level in student 

tc*xt wan "appropriate" 

8, ) Residing lavol of student text 

waH "appropriate" 



70.69 



86.21' 



93,33' 



100,00 



87.50" 



84,48 



81. 36 



78.95 



n,54 



80.00 



70.89 



93.05 



78.95 



90,79 



64.71 



81.25^ 



56.25 



50-^ 



41. Ifi 



ro. 59 



87.50 



78.37 



lU^portud percentages are averaged across minittodules in each content area. 



(Criterion achieved. 
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TABLE 16 



COOTARISON OF SELECTED PROJECT ECHO MINIMODULE 
IMPLEMINTATION VARIABLES BY SUBJECT AREA 



Vari/il) lij 



Language Arts Mathemat ics 



Average.' nuitiber o£ atudente 
expOHt ci to each mlnimodule 



142,9 



179.7 



141,6 



Avoragt' pupil Instructional 253 246 15b 

t imii in minuCcs per miTiimodule 



Avcrai^o toacher preparation 69 53 92 

Lime in minutes per 
min imodule 
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SUMMARY AND RECOhmENDATIONS 
Overall, the effects of Project Kcho intervention on secondary level 
Luarnlng disabled students are consldfrud positive, A beneficial influence^ 
on acadi'ialc achievement In the subJcrL HreaH addrGssGd by the Instructional 
eDmponcnt waa noted. Echo target studtints dropped out of school during the 
intervention period at a rate less than would be expected but did not 
improve their attendance rates as desired. 

Two Project Echo components , parent involvement and ceacher training, 
were not fully Implemented as proposed, but increased levels of parent-- 
school communication were found at all sites and a majority of the Echo 
teachers demonstrated the ability to effectively implement the program 
after having received only portions of the teacher training* 

The srreenlng and appraisal process was accomplished — as proposed, 
for the identification of Cohort 1 students, and with modifications , for 
Cohort 2p Scheduling dlfflcultiea and excessive time requirements were 
still noted as negative features o^ the process. 

The effects of the observer school dissemination strategy ^ which 
provides project Infomation to a network of preselected potential 
adopters, is inconclusive at this time* 

Project Echo teachers were generally positive In their perceptions 
regarding the appropriateness of the minimodules for learning disabled 
students. Teachers who used the Language Arts and Mathematics materials 
reported more pdsitlve feelings than did teachers using the Science inlnl-^ 
modules . 

The implementation and evaluation of Project Echo at five new 
test sites has identified both strengths and weaknesses of the products 
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aiid prucessuH which resulted from the Corslcana Project* All findings are 
not conclusive, however j they are based on data gathered from a very saall 
portion of the Intended target audience in a limited nimber of sites* Thi 
^tudy nevertheless does tend to indicate that Project Echo is replicable 
with a potGntial for beneficial influence on^ the education of le arning 
dlHahled studentB, 



An endeavor such as Project Echo invariably stimulates the asking 
of questions not previously conceived and generates ideas for spin-off 
projects among the project's planners, participants, and observers, A 
series of recommendations, based on questions and ideas resulting from 
Project Echo, will conclude this report* 

1) The development of additional instructional mlnlmoduies — 
in more subject areas and for learning disabled students of 
other age groups — should be seriously considered. 

2) The screening and appraisal process, though ii^erfecti addresses 
a need of Texas Plan A schools for a reliable and valid means 
for diagnosis of learning disability. Further study is 
warranted, 

3) Thu Long-term effectiveness of Project Echo's observer school 
approach, as a strategy for dissemination of educational 
products and processes, should be Investigated through a series 
of follow-up surveys conducted for the next several years. 
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TECHNICAL ATTACIMENTS 

1, Academic Achievement 

2. Student Attendance 
3* Student Dropouts 

4. Screening and Appraisal 
5* Data Collection Forms 
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ATTACIMENT 1 
ACADEMIC ACHIEVMINT 
To provide an achievement battery appropriate to the reading level of 
each identified learning disabled student, three different SATB formi were 
used. The form selected for each student was based on that student *s 
reading comprehension grade equivalent (G.E*) as determined by the Stanford 
Diagnostic Reading Test administered as a part of the screening and appraisal 
process. Those with reading comprehension G.E.'s of 5.5 or lower were 
administered the SAT Intermediate Level 1 Battery (Inti-1). The SAT 
Intermediate Level 2 Battery (Int. -2) was admlaistered to students with 
a reading COTiprehenslon G.E. between 5.6 and J.O, while those with G.E.'s 
of 7.1 or higher received the SAT Advanced Level Battery (Adv.). The 
number of students tested with each form wasi 



SATB Fora N-Cohort 1 N-Cohort 2 

Int.-l 16 48 

Int. =2 16 78 

Adv. U 25 

TOTAL 60 151 

The SATB Int.-l* Int. -2, and Adv, Fonns consist of 10, 9* and 8 subtests, 
respectively, as follows i 

Language Arts Int .--1 Int>--2 Adv. 

Word Meaning / / 

Paragraph Meaning / J J 

Spelling / / / 

Word Study Skills / 

Language / / / 
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Comp ut at Ion / / / 

Cdnccpta / / / 

App llcat lona / / / 

SQGlal Studies / / / 

Selenee ^ / / / 



Since tha Word Meaning and Word Study Skilla subtests do not appear 
on all SATB forMp student sample aizes are reduced for these subtests. 

For tmderstandlng the findings regarding question of Interest 1, it is 
Important to distinguish between absolute grade equivalent gain and rate of 
grade equivalent gain. Absolute gain is the arithmetic difference between 
grade equivalent values obtained at two different tlmeS| l,e., posttest G,E, 
minus pretest G.E, Rate of grade equivalent gain considers the absolute 
gain in relation to the time difference (expressed in G,E, units) between 
the pretest and posttest administrations. As the actual time difference betwe 
SATB administrations for Echo students varied between four months and eight 
months J the latter coaputatlons rate of grade equivalent galn^ was used for 
all analyses to provide a correction for administration time differences. 
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ATTACHhffiNT 2 

The percentage actendmice change for each student was Individually 

cofi^uted by thm formula i 

% ChMige ■ (100) ( (100 - II) ^ (100 ^ BZ) )/ (100 ^ BI) 

where I t% - percent of days preaant during Impleaentatlon year. 
1975-76 

B% - percent of days present during b^siellne years, 1972-75 

This formula Intarprets the percent change as percent decrease in 

absenteeism so that a negative change is considered a desirable outcome* 

For evaluation question 23, the percentage of students whose resulting 

% change value waa -6,00 or a negative value of greater magnitude than 

-6*00 was tabulated, A similar procedure was employed for evaluation 

question 2y, except that a criterion value of -10,00 was used. 

Group mean attendance rates were computed by the formula i 

X Attendance % ^ 100 (EP)/£E 

where I EP ^ sum of days present for all group nembers 

. EE - sum of days enrolled for all group members 

For computations related to evaluation questions 2c and 2d, the % chang 

fomula (sae above) was ataployed except thati 

1% = mean attendanca percentage of Echo students during implamentation 
year, 1975-76 (both 2c and 2d) 

B% ^ mean attendance percentage of non^Echo comparison students during 
implamentation year, 1975-76 (2c only) 

B% ^ mean attendance percentage of 75-76 Echo students during basallne 
years. 1972-75 (2d only) 
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ATTACffilENT 3 

The peifcentage of dropout i (dropout rate) for wach group Was computed 
by tha formula: 

Dropeut Rate (%) (100 U^) / 

whare: N ^ nuabar of atudanta dropping out of lehool during 
the designated tlma period* 

Ng ^ nmber of students enrolled in school during 
the designated time period. 

To determine the dropout rate for the 15-year-old samples for the 

two years preceding Echo Implementation, the average annual number of 

dropouts and average annual nimber of enrollees were used. 

The percentage difference in dropout rate between an Echo group and a 

reference group was computed using the dropout rate percentages determined 

for the ^o contrasted groups with the following formula: 

% Difference ^ (E% - R%) / R% 

wherei E% ^ dropout rate percentage of Echo student group* 

R% = dropout rate percentage of non-^Echo reference group. 

This formula Interprets the percent difference as percent fewer 
dropouts in the Echo group so that a negative difference Is considered a 
desirable outcome. 
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A SCREENING PROCESS RELATED TO PROJECT ECHO 



Bill D, Lamkin 
Baylor University 
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ATTACHMENT 4 

EDUCATION SERVICE CENTER REGION XII 
rO. Bml249 Waco, Texas 76703 
401 PrankUil Ave. Td. 8 1 7^756 7494 

A SCREENING PROCESS RELATED TO PROJECT ECHO 

BY DR, BILL D. LAMKIN 
BAYLOR UNIVERSITY 




For tha Initial scratning of potential L/LD students to be involved 
in Projeet ECHO, two tests were adminiitered In the Spring of 1975 
to all IS year old students: The Test of Academic Progress and the 
Cognitive Abilities Test* Since the chronological age of the 
students would plaee them in the tenth grade , the tenth grade levels 
of each test were adroinistered. Tests were scored by the Koughton 
Mifflin Company and reported in terms of percentiles and standard 
SQorts « 

Since the proposal called for identifying students on the basis of 
a discrepancy between expected achievement and actual achit veinent . 
the following process was developed for the initial screening^ 

1, The standard scores (equivalent to an IQ) from the Cognitive 
Abilities Test, Verbal Battery, was used as the estimate of 
the student's intellectual functioning* The Verbal Battery 
was chosen over the Quantitative and Non-verbal Battery 
since^ according to the author, it Is most closely related 
to school achievement. On page 3 of the Examiner's Manual, 
the author states, "Since the bulk of education is presented 
through verbal lyinbolism, the relevance of a verbal test for 
educational prognosis and diagnosis is clear. Tests of 

•verbal reasoning have always been among the best predictors 
of educational progress.'' 

2, Students whose IQ fell below 70 on the Verbal Battery, 
were considered to be possible candidates for a program for 
the mentally retarded and thus were not identified for the 
screening process^ 

3, Using the information presented on page 31 of the Manual 
for Administrators, Supervisors and Counselors for the 
Test of Academic Progress , Table I was developed to 
designate the expected standard score for the Test of 
Academic Progress in relationship to the standard scores 
for the Test of Cognitive Abilities ranging from 70 to 100. 
EApected level for students at the 100 score of above was 
placed at the Mean Scores for the tenth grade students. 
In this case, the Mean Standard Score on the Test of 
Academic Progress for tenth grade students was SI. 

The screening guidelines called for "a discrepancy of two 
or more years between actual grade equivalent scores in 
reading comprehension or mathematics computation and 




TABLE I 



CAT Verbal 
IQ 


Expected SS Level 
Conposltlon 


on TAP 

Res ding 


HatheniClei 


lOOf 


51 


51 


51 


95-99 


47 


47 


48 


90-94 


45 


44 


46 


85-89 


43 


42 


44 


80-84 


40 


39 


41 

l" L 1 1 ■ 1" 1 1 !■ II 1 1 1 ~ 


75-79 


38 


37 


39 


70-74 


36 


35 


38 
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cbneept skill and the expected grade equivalent scores 
based on the itudent's mental age*'* Since test batteries 
administered to students in the ninth grade and above are 
not typically reported in grade p 1 aceinent s ^ grade 
placement scores were not available. An examination of 
the norm tables revealed that three standard score points 
represented approximate ly one year in achievement ; 
therefore^ it was assumed that a discrepancy of 7 or more 
standard score points between expected achievement and 
actual achievement would represent a discrepancy of two 
years. This was adopted as the guideline. 

S, All students who had a discrepancy of 7 or more points 
between their expected standard score and their actual 
standard score on composition^ reading, or mathematics 
was identified for further screening. 

The following steps will be Included in the in-depth screening: 

1, According to the proposal in order to be eligible for a 
designation as a learning disabled child, the student must 
have "a fgyit year discrapancy from the national or local 
norms of the academic achievement of his age group." 
Therefore, the Initial step in screening will be to 
examine the standard scores of students in the three areas 
considered in the original screening. Using the guideline 
for three standard scores points for each year of 
achievement, any student who scores 39 or above would fall 
less than 4 grade levels below his chronological age 
placement, and thus would be ineligible and should be 
omitted from further screening. 

2. A second step involves an examination of the standard 
'scores from the Test of Cognitive Abilities* Students 
who score below 70 were not identified for screening; 
however, some students with verbal scores above 70 may have 
scores on the other two sections of the tests below 70 and 
thus might need to be screened for possible inclusion in a 
program for the Mentally Retarded. 

3* Those students remaining on the list should be given 
additional testing as follows i 

a. The WISC-R 

b. The Detroit Test of Learning Aptitude 

c. The Stanford Diagnostic Arithmetic Test 

d. The Stanford Diagnostic Reading Test 

4, Data from these tests should be transferred to the L/LD 
Profile Analysis (Table II). 
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TABLn II 



Co4el 



L/LD PROFILE ANALYSIS 



WISD-R 



Y#er Msnih Day 



Dott Ttf ltd 
P<pto of Sirth 



f •ff^rmanct Scope 



VERBAL TIITS 

Infennetisn 

SimnefHics 

Aririim«tl€ 

Vscebulary 

Com|ireHtnsldfi 



lew 



pictiift C@fiiplMn >^ 

Obitcf iUsvmbly ^ 
Coding ^ 



Detroit Tests of La§rning Aptitude 



'c^l^tid Seen 



.?$ . 19 . _ If 



. ! j M 



•n-m 



Mi I 



i M N ' I 



i I 



j I 



i I ( 

I ; I 



STANFOnn DIAGNOSTIC ARITHMETIC TEST STANFORD DIAqf-'OSTTC READING TEST 
FoRM*W Level II Form W Level 11 
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students whose Pull Scale WISC-R IQ is 70 or below should 

Sentnffrn . J l'^^^^' Pl*""®"* ^ program for the 
Mentally Retarded and are Ineligible for inclusion in the 
L/ LD program * 

Data for students whose Full Scale IQ i, above 70 should 
be transferred to the Worksheet to deteriiilne eligibility 
for the program (Table III). " 
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TAitB III 
WORKSHEET 



Nsn# ; 



Indicated 
. Hot Indicated 



Letrninj DlsabiHty by crittria of 
thrte or mora years b#low mental 
aj0 on three subtests of the 
Detroit Teat of Laarning Aptitude 
or two subtesti in two different 
areas of the Detroit Test* 



WlSC-R full seale IQ ^ 

C A iy^^TB and sonths) ^ _____ 

C A (montha} ^ ^ 

M A Cyears and months] ^ 

M A ^ I Q X C A CWISC^R Manual; page 188) 
W A tin months) ^ x m 



M A (in years and months) m 

Critical Age for 

Detroit Subtasts ^ 



Critical Age ^ (M A) - (3 



iM A (in mon ths) 
12 



Three years discrepancy between ictual 
performance (Detroit subtests) and 
indicated ability (WISC^R full scale) 

0) 

0) - 



Areas on, Detroit Subtests in which studant's performance falls on 
or below the critical age: 



4 , Im Vmri'j^ 



1^ MaS AiiOitscst 1« 



§ . QiMFMiirvd ^ 
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TABLi: IJT t CONT I NUG D) 



1!! SC !."•■" A?m:^ be i:. I, UN ".LHTM AGE AND ACHIEVEMENT LEVtL* 



NA*-';; 

iNniCA'n;'' L,;.,.^_ 
NOT INIMCAT 1/ \A _ 
QUESTION. ■ l^LL ^:TA^b> 



1 I 



M. A 

t 

7 

S 

9 
10 
1 1 
12 
1 3 
14 

Its 

16 
1 7 



'n;atm coMPuiATinK (z; 

MATiE TOTAL (AVCj 



READING 

COMF'Ri;HliNS'0: 



CODE # 
M. A. 



EXPECTED XCHlc:Byk:,l LhVEL 
IN GRADE :.iQUI VALENTS 



EXPECTSr 
ACHTEVEME 
LEVEL 



ACTL'AL 

achieveme; 



D 1 5 C n E i 



• Stutlcni musu szora at least four (■'■ } years belcw 
chronological grad::' place me nt tn by eligible. Thus 
all ftiidttnts musr. \iAva one or more achieveinent 
t;?st scores oelow 6.6, 
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P li u J K c T p; c ii a 



I give permission for my child 



to receive any psychologioal and/or educational testini 
that may be deemed advisable through Froject ECHO 



I give permission for relea-j of relevant data to any 
agency requesting such information; also, I give per- 
mission for the release of data or information held by 
other agencies to the staff of Project ECHO. 



ALSO 



ERIC 



I will secure a physical examination for my child by a 
physican. 



Signature of Pa ^t or 
Guardian 



Tho primary lariguage apokGn in the home of 

child ' s name 

io 



^. , iiignature of Parent or 
D I Guardian 
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DATA COLl,,CTION FORMS 
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PROJECT ECm 
STUDliNT ATLEmMiCE Ri'lCORD FORM 

This form Is to be completed for all car,-et and nun-targGt: students. 

The purpose of this data gathet^ing instrurr.ent is to track the atcen^ 

dance patterns of studenEs exposed to PROJECT ECHO vs those who are 

not Involved in the project* 

1. There are two f orms ^ one for students who under^rent PROJECT 

ECHO screening during the Spring of 1975, and a separate form 

for students acreened during the Fall of 1975. 

NOTE: Attendance data for target and non-target 

15^year=olds from 1974-75 which has already 
been recorded on last year's fonns need 
not be transferred to the new forms* Only 
1975-76 attendance data should be entered 
for those students. 

2* Record the student 's name (last name, flist, middle initial), 

along with the sciiool name. Place a check nark in the column 

follnwing the namu of each identified tarp.fit student* 

3. Recorci for each student the days present, the days absent ^ and 
the total days enrolled (tlie etirolled days sh^juld remain con^ 
stant for most of the students). If a student was not enrolled 
during one of the reporting periods, record a dash (-) in th€ 
appropriate column/columns. 

4, When the 1975-76 screening and appraisal has been completed and 
the new group of target students has been identified , Indicate 
which students are PROJECT ECHO participants by placing a check 
mark in the column following each tar^iet student's nme. 
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*L'se this torn for studencs icrisned during the FaU senesEir of 1975. 
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IM^OJECT ECHO 
DROPOUT HATA GATHmaNG FOWl 

Ki rord Lhc* sclinol from which the data are being collecced and then 
r(M;ord each of the requested total numbers of enrollees and dropouts 
lor the fipcciiried HchooL years, 

f't)fcial ciare .stiould be taken to separate the target and nQn^targec 
Htudents when entering data for 1975^76. 

Sciiool 

Nuinher of l5-^y t*nr-^uJ d enrollees during Che 72^73 school year _ 

Niiml)er of IS^yenr-nld dropouts during the 72^73 school year 

Niimlier of 15^year-old enrollees during the 73^74 school year 

Number of l5^year^old dropouts during the school year 

Number of 15-year^old enrollees during the school year _ 

Nuniber of IS^yenr^old dropouts during the Ik^lS school year 

Number of 15-year^old target student enrollees during the 75-76 school 
ye /I r 

Number of 15^yGnr--old target student dropouts during the 75-76 school 
yonr 

Number of IS^year^old non^targat student enrollees during the 75-76 
school year 

Number of IS^year-^oid non^target student dropouts during the 75"76 
Bchuol year 104 



PRO.JKCT ECHO 
I'AKKf.'T INVOLVEMENT ACTIVITY REGISTER 
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At each Parpnt Involvement Activity meeting, have a staff member positioned 
tiear the donr of the meeting place to register each parent or parents as 
they enter* Ask the staff member to record the achool name and date of 
the meeting prior to the parents arrival* The staff member should also 
log the parents' name and the names of all children in the family who are 
involved in PROJECT ECHO, 
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PHO I a:T ECHO 
PARKNT IMVOLVEMiLNT ACTIVITY REGISTER 

SCHOOL . 

DATE OF ACTIVITY 

ACTIVITY rnJMBER 



PAWFMT/PARFNTR ?IA^fK NA^CE OF CHILD/CHILDREN IN PROJECT ECHO 
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pROjfa:? I- Clio 

DIHSKMINA'IION CONKERENCE REGISTER 



Havu n Hi/iil mcMTiher puKiLionud near the door of the meeting place and ask 
him to rvcovi] lUl- nnme of each person attending the conference, as well as 
the urgnnizntinn represented* 

The school name and date of the conference ahould be filled in on the 
register prior to the metiting. 
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PMJECT iCHO 
TB\CHER CIIECKLIST 



Haine oi Tcachar: 

Bchool/Ciryt ^/ 

Darei 

Chack Iff . Echo Teacher; Mainstream Teachar 



Pleaaa indicate which Mlntaodule Is being dlseusssd on the following Checklist, 

Language ArtSj Hlnlmodule i f 
Scimct, Mlnimodule fi 
Mathematics, Minlmodule # 

NuBiDer of students completing this Minlmodulef 

I. How much time vas required for most pupils to complete this Minlmodule? 
minutes 

2* Was th^ time for completion of this Minlmodulai 
^ coo short for inos; pupils 
____ about right for moat pupils 
_ too long for most pupils 

1. How much time was required for you to prepare for teaching this Mlnimodule*? 
minutes 

4* Was the quantity of materials included for use trtth the Minlmodulei 
too many 

about right 

too few 

____ none were included (skip to item 6) 

5. Was the quality of these materials included for use with the MInimodiilo: 
poor 

adequate 
_ excellent 
none w^re included 

6. Was the perceivad pupil interest in the Mlnimodule i 

_ low for most pupils 

_ adequate for most pupils 
high for moFt pupils 
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T. Was the vocabulmry used iti the student text I 
tOQ difficult for most pupils 

appropriate for most pupils 

coo easy for most pupils 

8, Was tha reading dlffleulty level of the student textl 
too complicated for most pupils 
appropriate for most pupils 
too simple for mo.^t pupils 

9* U'ds the objective of thia Hinlmodulei 
too difficult for most pupils 

appropriate for most pupils 

to© staple for most pupils 

10. V'as the MaBtary Te.st of this HlnjAOdule: 

an unsatisfactory measure e£ actual pupil mastery 
an adtiauace measure of actual pupil aastery 
an excellent measure of actual pupil mastery 

11. Did you have to make any changes or modlf Icatlonii In the Mlnlmodule? 
No (skip to item 13) 



If "yei-*j please speedy the changes or modifications made In the Minlmodule. 



I J* What Improvements or modifications in the Mlnlmodule would you raconunend? 



14. neneral Comments i 
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